-- Logs begin at Mon 2021-12-13 16:07:30 UTC, end at Mon 2021-12-13 17:11:06 UTC. -- Dec 13 16:34:53.004086 dv-cinder-821602-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Dec 13 16:34:53.011533 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Dec 13 16:34:53 2021] *** Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: nodename: dv-cinder-821602-2-iscsi Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: machine: x86_64 Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: clock source: unix Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: pcre jit disabled Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: detected number of CPU cores: 4 Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: current working directory: / Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: detected binary path: /usr/bin/uwsgi-core Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: your processes number limit is 47680 Dec 13 16:34:53.013779 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: your memory page size is 4096 bytes Dec 13 16:34:53.014439 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: detected max file descriptor number: 2048 Dec 13 16:34:53.014439 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: lock engine: pthread robust mutexes Dec 13 16:34:53.014439 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: thunder lock: enabled Dec 13 16:34:53.014439 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Dec 13 16:34:53.014439 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Dec 13 16:34:53.058664 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: Python main interpreter initialized at 0x5585d89bd9c0 Dec 13 16:34:53.058664 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: python threads support enabled Dec 13 16:34:53.058664 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: your server socket listen backlog is limited to 100 connections Dec 13 16:34:53.058664 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: your mercy for graceful operations on workers is 90 seconds Dec 13 16:34:53.059030 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: mapped 403077 bytes (393 KB) for 2 cores Dec 13 16:34:53.059104 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: *** Operational MODE: preforking *** Dec 13 16:34:53.059379 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: *** uWSGI is running in multiple interpreter mode *** Dec 13 16:34:53.059379 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: spawned uWSGI master process (pid: 86079) Dec 13 16:34:53.059624 dv-cinder-821602-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Dec 13 16:34:53.061033 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: spawned uWSGI worker 1 (pid: 86094, cores: 1) Dec 13 16:34:53.061033 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: spawned uWSGI worker 2 (pid: 86095, cores: 1) Dec 13 16:34:53.061033 dv-cinder-821602-2-iscsi devstack@keystone.service[86079]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 13 16:34:58.336536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:34:58.336536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: from cryptography.utils import int_from_bytes Dec 13 16:34:58.337388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:34:58.337388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: from cryptography.utils import int_from_bytes Dec 13 16:34:58.337815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:34:58.337815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: from cryptography.utils import int_from_bytes Dec 13 16:34:58.337915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 13 16:34:58.337915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: from cryptography.utils import int_from_bytes Dec 13 16:34:58.386267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 13 16:34:58.386465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 13 16:34:58.386549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 13 16:34:58.386631 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 13 16:34:58.386696 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] command line args: [] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 13 16:34:58.386759 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] command line args: [] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 13 16:34:58.386822 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 13 16:34:58.386973 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 13 16:34:58.387061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ================================================================================ {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 13 16:34:58.387123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ================================================================================ {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 13 16:34:58.387236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] admin_token = **** {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.387385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] admin_token = **** {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.387477 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] config_dir = [] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.387652 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] config_dir = [] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.387782 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.387782 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] config_source = [] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.387911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.387971 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] debug = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.388029 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] config_source = [] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.388177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] debug = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.388319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.389674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.389785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.389865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.389932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.389992 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] list_limit = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] list_limit = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390439 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] log_config_append = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390495 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] log_config_append = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390616 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] log_dir = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] log_dir = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390806 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] log_file = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390869 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] log_file = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.390999 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.391065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.391133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.391197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.391261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.391325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.391397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.391464 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.391877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.391938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392002 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392196 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392464 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.392964 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.393103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.393238 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.393306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.393365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.393563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.393754 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.393961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.394239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.394373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] publish_errors = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.394459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.394624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] publish_errors = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.394755 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.394843 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.394921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.394998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.395140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.395258 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.395370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.395568 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.395702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.395823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] standard_threads = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.395953 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.396073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.396186 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] standard_threads = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.396303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.396427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.396540 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.396680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.396792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] use_journal = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.396904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.397017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] use_json = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.397150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] use_journal = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.397265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] use_stderr = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.397382 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] use_json = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.397494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] use_syslog = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.397611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] use_stderr = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.397723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.397846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] use_syslog = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.397965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.398071 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 13 16:34:58.398182 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.398298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.398430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.398554 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.398667 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.398778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.398889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.399005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.399118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.399311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.399498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.399613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.399725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.399837 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.399955 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.400076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.400197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.400311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.400422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.400539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.400673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.400799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.400913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.401025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.401143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.401261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.401373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.401493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.401612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.401726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.401837 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.401948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.402060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.402191 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.402312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.402424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.402536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.402653 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.402771 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.402891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.403010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.403125 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.403244 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.403364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.403477 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.403601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.403721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.403721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.403932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.404049 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.404169 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.404284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.404395 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.404506 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.404638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.404752 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.404952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.405068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.405181 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.405298 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.405411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.405522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.405641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.405754 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.405872 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.405984 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.406095 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.406206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.406326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.406445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.406564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.406677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.406794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.406913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.407033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.407146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.407262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.407374 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.407486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.407603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.407724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.407843 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.407956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.408077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.408255 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.408437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.408657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.408788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.408902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.408998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.409092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.409187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.409290 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.409387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.409481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.409577 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.409672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.409767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.409892 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.410000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.410097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.410198 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.410294 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.410408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.410529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.410643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.410755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.410867 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.410987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.411101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.411219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.411332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.411484 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.411664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.411837 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.412020 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.412204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.412391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.412517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.412660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.412776 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.412895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.413018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.413140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.413254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.413366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.413478 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.413598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.413712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.413833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.413946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.414058 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.414169 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.414281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.414393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.414512 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.414630 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.414733 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.414845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.415038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.415157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.415280 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.415395 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.415508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.415611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.415723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.415843 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.415965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.416079 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.416191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.416304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.416415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.416533 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.416789 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.416789 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.417008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.417120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.417232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.417344 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.417465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.417587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.417703 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.417823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.417937 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.418055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.418176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.418290 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.418402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.418514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.418627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.418739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.418864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.418980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.419105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.419229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.419343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.419455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.419567 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.419687 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.419800 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.419904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.420012 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.420124 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.420236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.420356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] auth.external = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.420470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.420597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.420713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.420826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.420951 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.421075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.421190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] auth.external = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.421302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] auth.password = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.421414 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.421525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] auth.token = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.421643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.421765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.421881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.421993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.422176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] auth.password = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.422293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.422406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] auth.token = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.422531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.422646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.422765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.422878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.422997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.423116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.423239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.423353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.423465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] credential.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.423577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.423717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.423840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.423955 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.424068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.424189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.424305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] credential.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.424417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.424417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.424654 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.424769 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.424899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.425006 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.425117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.425230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.425344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.425456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.425578 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.425694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.425807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.425807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.426017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.426130 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.426250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.426366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.426478 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.426591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.426703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.426703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.426923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.427037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] federation.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.427149 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.427262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.427375 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.427488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.427609 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.427723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.427835 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.427948 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.428060 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] federation.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.428172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.428294 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.428410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.428523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.428678 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.428793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.428907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.429032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.429164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.429288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.429403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.429519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.429641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.429755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.429875 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.429989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.430101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.430213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.430403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.430539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.430696 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.430811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.430934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.431050 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.431171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.431286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.431400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.431512 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.431633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.431746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.431868 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.431989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.432103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.432215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.432328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.432449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.432588 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.432706 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.432830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.432945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.433059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.433059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.433279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.433408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.433523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.433637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.433750 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.433863 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.433985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.434100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.434213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.434326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.434438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.434551 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.434680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.434797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.434910 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.435023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.435135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.435248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.435369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.435484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.435597 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.435709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.435823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.435942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.436064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.436179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.436293 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.436405 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.436517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.436691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.436820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.436935 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.437048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.437172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.437287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.437400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.437528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.437642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.437755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.437869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.437981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.438099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.438221 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.438336 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.438448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.438560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.438560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.438771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.438894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.439008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.439121 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.439233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.439345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.439457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.439577 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.439692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.439804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.439917 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.440030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.440141 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.440263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.440383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.440497 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.440633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.440750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.440872 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.440988 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.441101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.441214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.441327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.441440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.441561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.441682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.441796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.441909 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.442023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.442136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.442257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.442373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.442486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.442599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.442711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.442824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.442947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.443062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.443176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.443297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.443411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.443524 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.443644 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.443760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.443873 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.444029 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.444148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.444262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.444384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.444505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.444635 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.444750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.444863 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.444976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.445101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.445225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.445339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.445452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.445566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.445678 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.445803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.445918 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.446031 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.446165 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.446284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.446397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.446519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.446644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.446759 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.446877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.446991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.447104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.447104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.447327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.447327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.447540 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.447540 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.447752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.447752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.447975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.447975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.448188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.448300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.448414 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.448535 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.448685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.448790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.448899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.448996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.449074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.449159 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.449233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.449304 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.449376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.449484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.449586 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.449710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.449835 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.449949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] resource.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.450062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.450174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.450293 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.450415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.450530 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.450643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.450757 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.450869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.450981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.451102 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.451218 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.451330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.451443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.451556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.451668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] resource.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.451788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.451903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.452015 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.452015 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] role.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.452225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.452225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.452509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] role.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.452509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.452792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.452905 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.453017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.453131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.453264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.453381 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.453493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.453608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.453721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.453842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.453957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.454070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.454181 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] role.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.454294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.454406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] role.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.454527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.454648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.454761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.454873 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.454986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.455098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.455219 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.455333 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.455446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.455559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.455673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.455785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.455785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.456007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.456120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.456232 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.456344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.456457 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.456597 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.456715 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.456829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.456942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.457055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.457167 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.457293 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.457408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.457522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.457635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.457635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.457846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.457968 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.458082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.458195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.458307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.458420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.458532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.458654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.458768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.458882 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.458994 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.459107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.459227 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.459342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.459455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.459567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.459679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.459791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.459912 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.460027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.460140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.460252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] token.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.460364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.460476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.460620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.460738 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.460851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.460965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.460965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.461177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.461298 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.461411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.461524 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.461636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.461748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.461925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.462051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.462166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.462340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.462463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] token.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.462577 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.462690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.462813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.462929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.463043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.463156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.463270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.463383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.463505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.463620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.463733 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.463847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.463959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.464073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.464195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.464309 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.464422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.connection = **** {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.464535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.464701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.464815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.464945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.465061 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.465176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.465288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.465401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.465514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.465636 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.465751 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.465865 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.465978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.466113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.466229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.466351 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.466467 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.466580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.466693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.connection = **** {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.466805 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.466928 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.467052 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.467176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.467292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.467405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.467518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.467632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.467744 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.467865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.467981 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468554 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86094) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 13 16:34:58.468903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.468903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.469846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 13 16:34:58.469846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86095) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 13 16:34:58.495294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.495560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.495778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.496792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.497021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.497242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.504321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.505855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.534014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.534218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.535622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.535864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.586266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.586525 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.634341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.634549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.634881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.635123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.701398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.701593 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.701810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.701943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.702081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.702169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.702232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.702305 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.702439 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.702519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.702583 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.702804 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.726002 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.726260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.726479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.726638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.726638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.726797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.726881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.726946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.727138 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.727267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.727426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.727557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.727557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.727856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.738529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.738966 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.751331 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.751494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.751606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.751706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.751774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.751935 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.752010 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.752073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.752133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.752289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.752388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.752623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.752771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86095) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.752908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86094) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Dec 13 16:34:58.770187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.770365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 13 16:34:58.770602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.770748 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.770885 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 13 16:34:58.770966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 13 16:34:58.771086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.771164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.771292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Dec 13 16:34:58.771371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.771531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.771622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.771801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.771928 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.772077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.772269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.782381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.782650 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.782919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.783062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.783150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.783227 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.783518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.783790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.791267 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.791821 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.794486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.794767 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.794994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.795121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.795285 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.795370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.795528 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.795654 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.795783 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.795881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.796028 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.796117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.796309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.796432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.796599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.796703 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.796829 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.796908 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.797082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.797208 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.797308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.797582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.823154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.823279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.824724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.824870 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.825012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.825134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.830038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.830165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.831983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.832130 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.832269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.832351 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.839534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.839654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.839808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.840006 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.844110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.844309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.844401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.844487 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.844689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.844823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.844920 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.845116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.845243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.845393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.845537 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.845660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.845783 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.845904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.846043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.846124 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.864200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.864325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.864464 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.864584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.868980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.869106 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.872521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.872665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.872931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.873059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.877806 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.877934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.881292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.881439 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.884899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.885142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.885268 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.885406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.885488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.885711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.885836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.885973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.886055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.886248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.886388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.886506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.905234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.905508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.905632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.905790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.905874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.905982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.906185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.906411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.913618 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.914087 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.915296 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.915562 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.915787 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.916065 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.918652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.918922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.919173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.919302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.919439 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.919540 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.919681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.919769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.919998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.920277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.932725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.933010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.933273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.933396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.933495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.933563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.933871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.933996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.934188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.934315 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.934453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.934549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.934779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.935055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.951920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.952620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.955074 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.955826 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.958292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.959076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.959961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.960802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.961574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.961891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.962168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.962547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.962818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.963089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.969355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.970221 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.970903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.971792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.974017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.974305 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.974692 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.974955 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.975099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.975308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.975644 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.975927 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.983820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.984097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.984597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.984875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.985168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.985444 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.991960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86094) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.992232 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.992501 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.992792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.993055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.993278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86095) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Dec 13 16:34:58.993503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.993648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.993733 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.993919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.994044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.994236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.994419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.994579 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.994707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.994833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.994954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.995091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.995219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.995347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.995474 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.995601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86094) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.995729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.995865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.996136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.996409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.996710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:58.996978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86095) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Dec 13 16:34:59.032732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585d89bd9c0 pid: 86094 (default app) Dec 13 16:34:59.034299 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585d89bd9c0 pid: 86095 (default app) Dec 13 16:34:59.036133 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c9a5a-5aee-4f13-bf7a-40828ebc7dc3 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:34:59.036424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c9a5a-5aee-4f13-bf7a-40828ebc7dc3 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:34:59.036718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c9a5a-5aee-4f13-bf7a-40828ebc7dc3 None None] PATH_INFO: `/v3` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:34:59.041011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Mon Dec 13 16:34:59 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:07.054820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06316b9-08f9-40f3-a0a4-cc47c78ae483 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:07.055767 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06316b9-08f9-40f3-a0a4-cc47c78ae483 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:07.055886 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06316b9-08f9-40f3-a0a4-cc47c78ae483 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:07.064151 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:07 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:07.070221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb42d-9aad-4957-8ef1-5e2e38e9e596 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:07.070631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb42d-9aad-4957-8ef1-5e2e38e9e596 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:07.070715 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccb42d-9aad-4957-8ef1-5e2e38e9e596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:07.103738 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG oslo_db.sqlalchemy.engines [None req-7eccb42d-9aad-4957-8ef1-5e2e38e9e596 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86094) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:35:07.296908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG passlib.handlers.bcrypt [None req-7eccb42d-9aad-4957-8ef1-5e2e38e9e596 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86094) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 13 16:35:07.297323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG passlib.handlers.bcrypt [None req-7eccb42d-9aad-4957-8ef1-5e2e38e9e596 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86094) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 13 16:35:07.352230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7eccb42d-9aad-4957-8ef1-5e2e38e9e596 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:07.353879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7eccb42d-9aad-4957-8ef1-5e2e38e9e596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:07.486662 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:07.672755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06316b9-08f9-40f3-a0a4-cc47c78ae483 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:07.715005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG oslo_db.sqlalchemy.engines [None req-a06316b9-08f9-40f3-a0a4-cc47c78ae483 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86095) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 13 16:35:07.848636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06316b9-08f9-40f3-a0a4-cc47c78ae483 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:07.854148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10eb30-85fd-4bf7-b9be-dd83e3fd681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:07.854803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10eb30-85fd-4bf7-b9be-dd83e3fd681d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:07.855076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10eb30-85fd-4bf7-b9be-dd83e3fd681d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:07.855350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10eb30-85fd-4bf7-b9be-dd83e3fd681d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:07.863741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10eb30-85fd-4bf7-b9be-dd83e3fd681d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:07.914802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ec10eb30-85fd-4bf7-b9be-dd83e3fd681d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 13 16:35:07.915352 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10eb30-85fd-4bf7-b9be-dd83e3fd681d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:07.925448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:07.933226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccb42d-9aad-4957-8ef1-5e2e38e9e596 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:07.957914 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccb42d-9aad-4957-8ef1-5e2e38e9e596 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:07.965478 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459869d-aaf1-4d9b-9def-c9519a2192c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:07.966606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459869d-aaf1-4d9b-9def-c9519a2192c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:07.966895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459869d-aaf1-4d9b-9def-c9519a2192c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:07.967175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459869d-aaf1-4d9b-9def-c9519a2192c0 admin admin] PATH_INFO: `/v3/projects/3ad2f264c1784427a00af5662d2bd264` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:07.968891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459869d-aaf1-4d9b-9def-c9519a2192c0 admin admin] RBAC: Authorizing `identity:get_project(project_id=3ad2f264c1784427a00af5662d2bd264)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:08.020700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9459869d-aaf1-4d9b-9def-c9519a2192c0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Dec 13 16:35:08.021042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459869d-aaf1-4d9b-9def-c9519a2192c0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:08.025816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:07 2021] GET /identity/v3/projects/3ad2f264c1784427a00af5662d2bd264 => generated 344 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:10.313624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b1e1-fa9b-414c-ad35-d63938c2c4d6 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:10.314527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b1e1-fa9b-414c-ad35-d63938c2c4d6 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:10.314527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9b1e1-fa9b-414c-ad35-d63938c2c4d6 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:10.322144 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:10 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:10.331557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e910be-8aea-42d5-8b2a-ac43e20cc11c None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:10.332083 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e910be-8aea-42d5-8b2a-ac43e20cc11c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:10.332237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e910be-8aea-42d5-8b2a-ac43e20cc11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:10.353245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-50e910be-8aea-42d5-8b2a-ac43e20cc11c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:10.354793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-50e910be-8aea-42d5-8b2a-ac43e20cc11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:10.364316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:10.393264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b1e1-fa9b-414c-ad35-d63938c2c4d6 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:10.410316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9b1e1-fa9b-414c-ad35-d63938c2c4d6 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:10.416674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41be210-823c-4cd9-9b72-ea3a7bd395ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:10.417320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41be210-823c-4cd9-9b72-ea3a7bd395ca admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:10.417611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41be210-823c-4cd9-9b72-ea3a7bd395ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:10.417893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41be210-823c-4cd9-9b72-ea3a7bd395ca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:10.426576 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41be210-823c-4cd9-9b72-ea3a7bd395ca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:10.428383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41be210-823c-4cd9-9b72-ea3a7bd395ca admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:10.438190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:10.445269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e910be-8aea-42d5-8b2a-ac43e20cc11c None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:10.459855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e910be-8aea-42d5-8b2a-ac43e20cc11c None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:10.466302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39443934-aa93-4739-874f-bcb3be50acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:10.467182 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39443934-aa93-4739-874f-bcb3be50acc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:10.467465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39443934-aa93-4739-874f-bcb3be50acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:10.467742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39443934-aa93-4739-874f-bcb3be50acc3 admin admin] PATH_INFO: `/v3/users/bc88850011704653a832fe050d8d83ab` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:10.469340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39443934-aa93-4739-874f-bcb3be50acc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=bc88850011704653a832fe050d8d83ab)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:10.471207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39443934-aa93-4739-874f-bcb3be50acc3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:10.472805 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:10 2021] GET /identity/v3/users/bc88850011704653a832fe050d8d83ab => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:12.888768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6618c14-ec66-4c02-bd14-3ffe885b284e None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:12.889332 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6618c14-ec66-4c02-bd14-3ffe885b284e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:12.889332 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6618c14-ec66-4c02-bd14-3ffe885b284e None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:12.891103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:12.897229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32263b-1884-462b-80e0-d0d90f32ec72 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:12.897643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32263b-1884-462b-80e0-d0d90f32ec72 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:12.897823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32263b-1884-462b-80e0-d0d90f32ec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:12.905952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af9724-4d21-4a5b-9d82-08e041500200 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:12.906239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af9724-4d21-4a5b-9d82-08e041500200 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:12.906483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af9724-4d21-4a5b-9d82-08e041500200 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:12.908194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:35:12.914148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e238e5c-ea4a-402b-a5d2-5ee1bbc07f5b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:12.914438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e238e5c-ea4a-402b-a5d2-5ee1bbc07f5b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:12.914716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e238e5c-ea4a-402b-a5d2-5ee1bbc07f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:12.917095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-2c32263b-1884-462b-80e0-d0d90f32ec72 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:12.918272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2c32263b-1884-462b-80e0-d0d90f32ec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:12.925681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 6/12] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:12.949054 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32263b-1884-462b-80e0-d0d90f32ec72 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:12.956175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG passlib.handlers.bcrypt [None req-1e238e5c-ea4a-402b-a5d2-5ee1bbc07f5b None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86095) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Dec 13 16:35:12.956618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG passlib.handlers.bcrypt [None req-1e238e5c-ea4a-402b-a5d2-5ee1bbc07f5b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86095) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Dec 13 16:35:12.958234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32263b-1884-462b-80e0-d0d90f32ec72 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:12.963084 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c827e-b7d1-4e2e-8740-0397f1b5c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:12.963871 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c827e-b7d1-4e2e-8740-0397f1b5c29b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:12.964142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c827e-b7d1-4e2e-8740-0397f1b5c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:12.964415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c827e-b7d1-4e2e-8740-0397f1b5c29b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:12.977557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c827e-b7d1-4e2e-8740-0397f1b5c29b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:12.984293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-6a2c827e-b7d1-4e2e-8740-0397f1b5c29b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:35:12.985495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 7/13] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:35:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:35:12.991447 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c827e-b7d1-4e2e-8740-0397f1b5c29b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:13.001370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c827e-b7d1-4e2e-8740-0397f1b5c29b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:13.002437 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-1e238e5c-ea4a-402b-a5d2-5ee1bbc07f5b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:13.004234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1e238e5c-ea4a-402b-a5d2-5ee1bbc07f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:13.006799 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7239b1f-677f-4def-b2d5-cadca6ca6e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:13.007429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239b1f-677f-4def-b2d5-cadca6ca6e4c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:13.007709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239b1f-677f-4def-b2d5-cadca6ca6e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:13.007978 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7239b1f-677f-4def-b2d5-cadca6ca6e4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:13.008846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7239b1f-677f-4def-b2d5-cadca6ca6e4c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:13.009224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7239b1f-677f-4def-b2d5-cadca6ca6e4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:13.011003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-b7239b1f-677f-4def-b2d5-cadca6ca6e4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:13.011003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:35:13.011003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:35:13.011903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7239b1f-677f-4def-b2d5-cadca6ca6e4c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:13.026277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 7/14] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:13.026407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 8/15] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:13.032309 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e238e5c-ea4a-402b-a5d2-5ee1bbc07f5b None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:13.042448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e238e5c-ea4a-402b-a5d2-5ee1bbc07f5b None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:13.046735 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dda705-a246-4d5d-908d-c4a0db57a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:13.047977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dda705-a246-4d5d-908d-c4a0db57a3fc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:13.048253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dda705-a246-4d5d-908d-c4a0db57a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:13.048531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dda705-a246-4d5d-908d-c4a0db57a3fc admin admin] PATH_INFO: `/v3/users/bc88850011704653a832fe050d8d83ab` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:13.049268 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7239b1f-677f-4def-b2d5-cadca6ca6e4c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:13.050149 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dda705-a246-4d5d-908d-c4a0db57a3fc admin admin] RBAC: Authorizing `identity:get_user(user_id=bc88850011704653a832fe050d8d83ab)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:13.052044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dda705-a246-4d5d-908d-c4a0db57a3fc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:13.053649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 8/16] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:13 2021] GET /identity/v3/users/bc88850011704653a832fe050d8d83ab => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:13.059265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dda705-a246-4d5d-908d-c4a0db57a3fc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:13.059702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7239b1f-677f-4def-b2d5-cadca6ca6e4c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:13.064613 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4260ef-0971-4b95-8500-6558c382082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:13.065264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4260ef-0971-4b95-8500-6558c382082d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:13.065552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4260ef-0971-4b95-8500-6558c382082d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:13.065826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4260ef-0971-4b95-8500-6558c382082d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:13.068424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dda705-a246-4d5d-908d-c4a0db57a3fc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:13.073632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98627363-fb89-4c01-aa63-6c0b2d99c6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:13.074162 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4260ef-0971-4b95-8500-6558c382082d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:13.074396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98627363-fb89-4c01-aa63-6c0b2d99c6ab admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:13.074674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98627363-fb89-4c01-aa63-6c0b2d99c6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:13.074948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98627363-fb89-4c01-aa63-6c0b2d99c6ab admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:13.075944 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4260ef-0971-4b95-8500-6558c382082d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:13.076172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98627363-fb89-4c01-aa63-6c0b2d99c6ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:13.077866 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98627363-fb89-4c01-aa63-6c0b2d99c6ab admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:13.079400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 9/17] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:13.084675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 9/18] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 13 16:35:13.085347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98627363-fb89-4c01-aa63-6c0b2d99c6ab admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:13.090448 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4260ef-0971-4b95-8500-6558c382082d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:13.095430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98627363-fb89-4c01-aa63-6c0b2d99c6ab admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:13.098753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4260ef-0971-4b95-8500-6558c382082d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:13.100329 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dce2d-dcbb-42b9-952a-4cb49c3c49d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:13.100977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dce2d-dcbb-42b9-952a-4cb49c3c49d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:13.101257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dce2d-dcbb-42b9-952a-4cb49c3c49d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:13.101528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dce2d-dcbb-42b9-952a-4cb49c3c49d7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:13.102448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dce2d-dcbb-42b9-952a-4cb49c3c49d7 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.domain.id=default, user.id=bc88850011704653a832fe050d8d83ab) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:13.102916 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dce2d-dcbb-42b9-952a-4cb49c3c49d7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:13.103606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02125237-80de-46d7-a506-26d015a6fb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:13.104361 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02125237-80de-46d7-a506-26d015a6fb9a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:13.104681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02125237-80de-46d7-a506-26d015a6fb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:13.104766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-841dce2d-dcbb-42b9-952a-4cb49c3c49d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:13.104766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:35:13.104766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:35:13.104983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02125237-80de-46d7-a506-26d015a6fb9a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:13.105885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dce2d-dcbb-42b9-952a-4cb49c3c49d7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:13.106114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02125237-80de-46d7-a506-26d015a6fb9a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:13.107777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02125237-80de-46d7-a506-26d015a6fb9a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:13.109356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 10/19] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:13.116824 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 10/20] 10.222.0.62 () {56 vars in 1343 bytes} [Mon Dec 13 16:35:13 2021] GET /identity/v3/role_assignments?user.id=bc88850011704653a832fe050d8d83ab&scope.domain.id=default&role.id=f3311ba27a464113b884aa5a1144945d => generated 233 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:16.009369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182c276-1d06-4cfa-85a6-b5dcf511799e None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.010450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182c276-1d06-4cfa-85a6-b5dcf511799e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.010954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d182c276-1d06-4cfa-85a6-b5dcf511799e None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.013605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 11/21] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:16.029826 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c48af-416a-4f1a-be1c-1815cffac190 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.030740 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c48af-416a-4f1a-be1c-1815cffac190 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.031232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c48af-416a-4f1a-be1c-1815cffac190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.052178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-977c48af-416a-4f1a-be1c-1815cffac190 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:16.053724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-977c48af-416a-4f1a-be1c-1815cffac190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:16.066803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 11/22] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:16.102437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182c276-1d06-4cfa-85a6-b5dcf511799e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:16.118779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d182c276-1d06-4cfa-85a6-b5dcf511799e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:16.123458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614000a-0dba-4d62-bec2-e9cc4ded9164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:16.124475 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614000a-0dba-4d62-bec2-e9cc4ded9164 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.124985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614000a-0dba-4d62-bec2-e9cc4ded9164 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.125456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614000a-0dba-4d62-bec2-e9cc4ded9164 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.142022 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c45af-63ac-4a85-85fd-cc32f75e7e5b None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.142618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c45af-63ac-4a85-85fd-cc32f75e7e5b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.143083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c45af-63ac-4a85-85fd-cc32f75e7e5b None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.145104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 12/23] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:35:16.147715 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614000a-0dba-4d62-bec2-e9cc4ded9164 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:16.151327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d7846-7898-4636-ad70-353d85f7ad71 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.151868 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d7846-7898-4636-ad70-353d85f7ad71 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.152336 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d7846-7898-4636-ad70-353d85f7ad71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.155436 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-4614000a-0dba-4d62-bec2-e9cc4ded9164 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:35:16.161455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 12/24] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:35:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:16.161455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f3daa-b3ff-4d11-9ad1-3ea498696de6 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.161455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f3daa-b3ff-4d11-9ad1-3ea498696de6 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.161455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f3daa-b3ff-4d11-9ad1-3ea498696de6 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.164888 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 13/25] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:16.166348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93140b-dcae-4d0e-b20f-3bdf7f20902d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.166456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93140b-dcae-4d0e-b20f-3bdf7f20902d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.166708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93140b-dcae-4d0e-b20f-3bdf7f20902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.194929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-054d7846-7898-4636-ad70-353d85f7ad71 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:16.196207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-054d7846-7898-4636-ad70-353d85f7ad71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:16.212509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 13/26] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:16.213162 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d7846-7898-4636-ad70-353d85f7ad71 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:16.239674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d7846-7898-4636-ad70-353d85f7ad71 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:16.250528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40193a7-3d2e-4797-b73b-af95070ca3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:16.251591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40193a7-3d2e-4797-b73b-af95070ca3bf admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.252095 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40193a7-3d2e-4797-b73b-af95070ca3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.252562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40193a7-3d2e-4797-b73b-af95070ca3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.253607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40193a7-3d2e-4797-b73b-af95070ca3bf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:16.254116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40193a7-3d2e-4797-b73b-af95070ca3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:16.255367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-d40193a7-3d2e-4797-b73b-af95070ca3bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:16.255367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:35:16.255367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:35:16.256673 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40193a7-3d2e-4797-b73b-af95070ca3bf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:16.285941 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 14/27] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:16.287156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40193a7-3d2e-4797-b73b-af95070ca3bf admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:16.308619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40193a7-3d2e-4797-b73b-af95070ca3bf admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:16.322280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c960d8-73d7-47ee-ad58-4522259f66c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:16.323338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c960d8-73d7-47ee-ad58-4522259f66c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.323570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-df93140b-dcae-4d0e-b20f-3bdf7f20902d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:16.323894 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c960d8-73d7-47ee-ad58-4522259f66c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.324248 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c960d8-73d7-47ee-ad58-4522259f66c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.325123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c960d8-73d7-47ee-ad58-4522259f66c4 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:16.326192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-df93140b-dcae-4d0e-b20f-3bdf7f20902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:16.326317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-a8c960d8-73d7-47ee-ad58-4522259f66c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:16.326317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:35:16.326317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:35:16.327633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c960d8-73d7-47ee-ad58-4522259f66c4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:16.345362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 14/28] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:16.349854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93140b-dcae-4d0e-b20f-3bdf7f20902d None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:16.366263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93140b-dcae-4d0e-b20f-3bdf7f20902d None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:16.374299 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c78a5-a466-4293-afba-284bd1e9813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:16.375350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c78a5-a466-4293-afba-284bd1e9813f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.375846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c78a5-a466-4293-afba-284bd1e9813f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.376311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c78a5-a466-4293-afba-284bd1e9813f admin admin] PATH_INFO: `/v3/users/bc88850011704653a832fe050d8d83ab` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.378575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c78a5-a466-4293-afba-284bd1e9813f admin admin] RBAC: Authorizing `identity:get_user(user_id=bc88850011704653a832fe050d8d83ab)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:16.380684 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c78a5-a466-4293-afba-284bd1e9813f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:16.382808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 15/29] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:16 2021] GET /identity/v3/users/bc88850011704653a832fe050d8d83ab => generated 247 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:16.388335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c78a5-a466-4293-afba-284bd1e9813f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:16.401238 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c78a5-a466-4293-afba-284bd1e9813f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:16.413329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ffb68-b729-49f5-a7ac-4db18f3dcb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:16.414316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ffb68-b729-49f5-a7ac-4db18f3dcb79 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.414819 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ffb68-b729-49f5-a7ac-4db18f3dcb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.415250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ffb68-b729-49f5-a7ac-4db18f3dcb79 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.416755 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ffb68-b729-49f5-a7ac-4db18f3dcb79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:16.418592 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ffb68-b729-49f5-a7ac-4db18f3dcb79 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:16.420669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 16/30] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:16 2021] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:16.422287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ffb68-b729-49f5-a7ac-4db18f3dcb79 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:16.432823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ffb68-b729-49f5-a7ac-4db18f3dcb79 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:16.444210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7c4c-5f19-4fe7-8f23-dec2c1ad977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:16.445065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7c4c-5f19-4fe7-8f23-dec2c1ad977a admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.445539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7c4c-5f19-4fe7-8f23-dec2c1ad977a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.445950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7c4c-5f19-4fe7-8f23-dec2c1ad977a admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.447154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a7c4c-5f19-4fe7-8f23-dec2c1ad977a admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:16.448323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-5b2a7c4c-5f19-4fe7-8f23-dec2c1ad977a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:16.448323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:35:16.448323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:35:16.449698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a7c4c-5f19-4fe7-8f23-dec2c1ad977a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:16.617669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 15/31] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:35:16 2021] POST /identity/v3/roles => generated 219 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:16.618770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c960d8-73d7-47ee-ad58-4522259f66c4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:16.643912 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c960d8-73d7-47ee-ad58-4522259f66c4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:16.657987 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 17/32] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:35:16 2021] POST /identity/v3/roles => generated 225 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:16.659362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf756ff3-d9d0-48cb-86f0-c7676379ccbe None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.659654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf756ff3-d9d0-48cb-86f0-c7676379ccbe None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.659934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf756ff3-d9d0-48cb-86f0-c7676379ccbe None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.663101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 18/33] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:16.670525 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb690-1bb6-4628-8248-e461a5e180b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:16.671446 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb690-1bb6-4628-8248-e461a5e180b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.671730 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb690-1bb6-4628-8248-e461a5e180b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.672007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549cb690-1bb6-4628-8248-e461a5e180b7 admin admin] PATH_INFO: `/v3/domains/default/users/bc88850011704653a832fe050d8d83ab/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.674234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d91e-9516-4beb-9e4a-ab3e6df8cfd2 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.674521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d91e-9516-4beb-9e4a-ab3e6df8cfd2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.674792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553d91e-9516-4beb-9e4a-ab3e6df8cfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.678359 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cb690-1bb6-4628-8248-e461a5e180b7 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bc88850011704653a832fe050d8d83ab, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:16.679585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-549cb690-1bb6-4628-8248-e461a5e180b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:16.679585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:35:16.679585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:35:16.681678 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549cb690-1bb6-4628-8248-e461a5e180b7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:16.709021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 16/34] 10.222.0.62 () {58 vars in 1382 bytes} [Mon Dec 13 16:35:16 2021] PUT /identity/v3/domains/default/users/bc88850011704653a832fe050d8d83ab/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:35:16.716164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f553d91e-9516-4beb-9e4a-ab3e6df8cfd2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:16.717874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f553d91e-9516-4beb-9e4a-ab3e6df8cfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:16.786894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 19/35] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:16.811726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb690-1bb6-4628-8248-e461a5e180b7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:16.822901 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549cb690-1bb6-4628-8248-e461a5e180b7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:16.827742 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885725e3-0018-4a73-ad83-12e19daa24b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:16.828587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885725e3-0018-4a73-ad83-12e19daa24b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.828930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885725e3-0018-4a73-ad83-12e19daa24b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.829259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885725e3-0018-4a73-ad83-12e19daa24b0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.855819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885725e3-0018-4a73-ad83-12e19daa24b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:16.858281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885725e3-0018-4a73-ad83-12e19daa24b0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:16.882041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-885725e3-0018-4a73-ad83-12e19daa24b0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:35:16.883727 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 17/36] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:16.890528 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553d91e-9516-4beb-9e4a-ab3e6df8cfd2 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:16.906300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553d91e-9516-4beb-9e4a-ab3e6df8cfd2 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:16.914694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a48bc-829a-43d2-a176-d6a1ca01974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:16.915428 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a48bc-829a-43d2-a176-d6a1ca01974a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.915788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a48bc-829a-43d2-a176-d6a1ca01974a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.916318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a48bc-829a-43d2-a176-d6a1ca01974a admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.917135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a48bc-829a-43d2-a176-d6a1ca01974a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:16.917447 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a48bc-829a-43d2-a176-d6a1ca01974a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:16.918703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-8e6a48bc-829a-43d2-a176-d6a1ca01974a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:16.918703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:35:16.918703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:35:16.919761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a48bc-829a-43d2-a176-d6a1ca01974a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:16.948164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 20/37] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:35:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:16.954823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885725e3-0018-4a73-ad83-12e19daa24b0 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:16.971038 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885725e3-0018-4a73-ad83-12e19daa24b0 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:16.981161 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137bf18-ff6c-4e82-8833-b4442addac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:16.982248 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137bf18-ff6c-4e82-8833-b4442addac55 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:16.982725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137bf18-ff6c-4e82-8833-b4442addac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:16.983210 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137bf18-ff6c-4e82-8833-b4442addac55 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:16.984170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137bf18-ff6c-4e82-8833-b4442addac55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:16.985469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-8137bf18-ff6c-4e82-8833-b4442addac55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:16.985469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:35:16.985469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:35:16.987083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137bf18-ff6c-4e82-8833-b4442addac55 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:17.029801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 18/38] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:35:16 2021] POST /identity/v3/projects => generated 301 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:17.274061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8780-c1cd-45c6-af2e-4b5dad05f5fd None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:17.274657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8780-c1cd-45c6-af2e-4b5dad05f5fd None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:17.274769 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a8780-c1cd-45c6-af2e-4b5dad05f5fd None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:17.276494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 21/39] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:17.282575 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94004b-de49-4a06-aa58-ba621e54c1e4 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:17.282998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94004b-de49-4a06-aa58-ba621e54c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:17.283164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94004b-de49-4a06-aa58-ba621e54c1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:17.304373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-fd94004b-de49-4a06-aa58-ba621e54c1e4 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:17.306135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fd94004b-de49-4a06-aa58-ba621e54c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:17.376017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 19/40] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:17.399013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a8780-c1cd-45c6-af2e-4b5dad05f5fd None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:17.411011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a8780-c1cd-45c6-af2e-4b5dad05f5fd None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:17.415259 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e338fe-fca3-4c3f-850d-11db1a4d6268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:17.415917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e338fe-fca3-4c3f-850d-11db1a4d6268 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:17.416204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e338fe-fca3-4c3f-850d-11db1a4d6268 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:17.416471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e338fe-fca3-4c3f-850d-11db1a4d6268 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:17.417269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e338fe-fca3-4c3f-850d-11db1a4d6268 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:17.418902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e338fe-fca3-4c3f-850d-11db1a4d6268 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:17.434270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 22/41] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:35:17 2021] POST /identity/v3/roles => generated 223 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:17.964291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bfe50-c0da-498d-bbf2-cc0f234e0a8f None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:17.964562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bfe50-c0da-498d-bbf2-cc0f234e0a8f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:17.964872 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bfe50-c0da-498d-bbf2-cc0f234e0a8f None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:17.966725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 20/42] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:17.972760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab18dc-5dea-4c64-8313-655c370984d8 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:17.973052 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab18dc-5dea-4c64-8313-655c370984d8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:17.973326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab18dc-5dea-4c64-8313-655c370984d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:17.992428 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7eab18dc-5dea-4c64-8313-655c370984d8 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:17.993828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7eab18dc-5dea-4c64-8313-655c370984d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:18.003283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 23/43] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:18.032659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bfe50-c0da-498d-bbf2-cc0f234e0a8f None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:18.046907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bfe50-c0da-498d-bbf2-cc0f234e0a8f None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:18.052402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ad8fa-33f4-4371-8ab2-fcbbcfc550d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:18.053409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ad8fa-33f4-4371-8ab2-fcbbcfc550d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:18.053693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ad8fa-33f4-4371-8ab2-fcbbcfc550d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:18.053960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ad8fa-33f4-4371-8ab2-fcbbcfc550d6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:18.055291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ad8fa-33f4-4371-8ab2-fcbbcfc550d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:18.057358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ad8fa-33f4-4371-8ab2-fcbbcfc550d6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:18.058970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 21/44] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:18.065146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab18dc-5dea-4c64-8313-655c370984d8 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:18.074737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab18dc-5dea-4c64-8313-655c370984d8 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:18.079605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9f716-afac-4b54-8cfb-22399212fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:18.080258 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f716-afac-4b54-8cfb-22399212fb86 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:18.080540 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f716-afac-4b54-8cfb-22399212fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:18.080846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9f716-afac-4b54-8cfb-22399212fb86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:18.081573 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9f716-afac-4b54-8cfb-22399212fb86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:18.082597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-53a9f716-afac-4b54-8cfb-22399212fb86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:18.082597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:35:18.082597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:35:18.083799 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9f716-afac-4b54-8cfb-22399212fb86 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:18.112736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 24/45] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:35:18 2021] POST /identity/v3/projects => generated 312 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:19.330366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9782c8-f598-42d6-b506-ded0e607d73f None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:19.330791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9782c8-f598-42d6-b506-ded0e607d73f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:19.330874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9782c8-f598-42d6-b506-ded0e607d73f None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:19.334068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 22/46] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:19.339021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a5ab1-d6e3-4461-b05f-423dfc4aff58 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:19.339469 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a5ab1-d6e3-4461-b05f-423dfc4aff58 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:19.339661 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a5ab1-d6e3-4461-b05f-423dfc4aff58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:19.358872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-e26a5ab1-d6e3-4461-b05f-423dfc4aff58 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:19.360062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e26a5ab1-d6e3-4461-b05f-423dfc4aff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:19.419000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 25/47] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:19 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:19.443843 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9782c8-f598-42d6-b506-ded0e607d73f None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:19.458281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9782c8-f598-42d6-b506-ded0e607d73f None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:19.464272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef203f2-41b5-45c6-a4a8-f65c987b307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:19.465101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef203f2-41b5-45c6-a4a8-f65c987b307e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:19.465385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef203f2-41b5-45c6-a4a8-f65c987b307e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:19.465658 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef203f2-41b5-45c6-a4a8-f65c987b307e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:19.478513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef203f2-41b5-45c6-a4a8-f65c987b307e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:19.485281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-7ef203f2-41b5-45c6-a4a8-f65c987b307e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:35:19.486451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 23/48] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:35:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:19.492788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a5ab1-d6e3-4461-b05f-423dfc4aff58 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:19.501643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a5ab1-d6e3-4461-b05f-423dfc4aff58 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:19.506202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e62d74-cbec-4222-a44a-5319d1db7d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:19.506861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62d74-cbec-4222-a44a-5319d1db7d30 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:19.507142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62d74-cbec-4222-a44a-5319d1db7d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:19.507414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e62d74-cbec-4222-a44a-5319d1db7d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:19.508180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e62d74-cbec-4222-a44a-5319d1db7d30 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:19.508683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e62d74-cbec-4222-a44a-5319d1db7d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:19.510233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e62d74-cbec-4222-a44a-5319d1db7d30 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:19.518662 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 26/49] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:19.524498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef203f2-41b5-45c6-a4a8-f65c987b307e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:19.535249 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef203f2-41b5-45c6-a4a8-f65c987b307e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:19.545374 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a5081-2e69-41ff-9489-73f0564e6888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:19.546096 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5081-2e69-41ff-9489-73f0564e6888 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:19.546380 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5081-2e69-41ff-9489-73f0564e6888 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:19.546657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a5081-2e69-41ff-9489-73f0564e6888 admin admin] PATH_INFO: `/v3/users/bc88850011704653a832fe050d8d83ab` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:19.548024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a5081-2e69-41ff-9489-73f0564e6888 admin admin] RBAC: Authorizing `identity:get_user(user_id=bc88850011704653a832fe050d8d83ab)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:19.549955 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7a5081-2e69-41ff-9489-73f0564e6888 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:19.551565 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 24/50] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:19 2021] GET /identity/v3/users/bc88850011704653a832fe050d8d83ab => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:19.557794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e62d74-cbec-4222-a44a-5319d1db7d30 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:19.567498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e62d74-cbec-4222-a44a-5319d1db7d30 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:19.574051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2271c-1f66-43b9-b0b7-06136d9dfb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:19.574776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2271c-1f66-43b9-b0b7-06136d9dfb8f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:19.575059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2271c-1f66-43b9-b0b7-06136d9dfb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:19.575333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2271c-1f66-43b9-b0b7-06136d9dfb8f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:19.576555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2271c-1f66-43b9-b0b7-06136d9dfb8f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:19.578475 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2271c-1f66-43b9-b0b7-06136d9dfb8f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:19.580076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 27/51] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:19.590185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a5081-2e69-41ff-9489-73f0564e6888 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:19.600697 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a5081-2e69-41ff-9489-73f0564e6888 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:19.606321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c9395-5973-447f-b2db-d5859f138889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:19.606967 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c9395-5973-447f-b2db-d5859f138889 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:19.607241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c9395-5973-447f-b2db-d5859f138889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:19.607619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c9395-5973-447f-b2db-d5859f138889 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:19.608490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c9395-5973-447f-b2db-d5859f138889 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.domain.id=default, user.id=bc88850011704653a832fe050d8d83ab) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:19.608839 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c9395-5973-447f-b2db-d5859f138889 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:19.610754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c9395-5973-447f-b2db-d5859f138889 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:19.619415 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 25/52] 10.222.0.62 () {56 vars in 1343 bytes} [Mon Dec 13 16:35:19 2021] GET /identity/v3/role_assignments?user.id=bc88850011704653a832fe050d8d83ab&scope.domain.id=default&role.id=f3311ba27a464113b884aa5a1144945d => generated 530 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:20.591724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59a25b-5787-44ce-b8fc-7a580768581f None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:20.592258 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59a25b-5787-44ce-b8fc-7a580768581f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:20.592258 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59a25b-5787-44ce-b8fc-7a580768581f None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:20.594028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 28/53] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:20.600907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b491e4-a5d1-4852-b885-646b83e3c754 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:20.601659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b491e4-a5d1-4852-b885-646b83e3c754 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:20.601781 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b491e4-a5d1-4852-b885-646b83e3c754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:20.624489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-d3b491e4-a5d1-4852-b885-646b83e3c754 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:20.625865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d3b491e4-a5d1-4852-b885-646b83e3c754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:20.636018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 26/54] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:20.660418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59a25b-5787-44ce-b8fc-7a580768581f None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:20.674660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59a25b-5787-44ce-b8fc-7a580768581f None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:20.679828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade9105-d25f-4072-aac0-6835663c2863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:20.680685 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade9105-d25f-4072-aac0-6835663c2863 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:20.681045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade9105-d25f-4072-aac0-6835663c2863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:20.681324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade9105-d25f-4072-aac0-6835663c2863 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:20.682565 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade9105-d25f-4072-aac0-6835663c2863 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:20.684250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade9105-d25f-4072-aac0-6835663c2863 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:20.685819 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 29/55] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:20.692384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b491e4-a5d1-4852-b885-646b83e3c754 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:20.704513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b491e4-a5d1-4852-b885-646b83e3c754 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:20.710346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e6587-e96f-476a-af8b-bf719706b04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:20.711005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6587-e96f-476a-af8b-bf719706b04d admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:20.711290 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6587-e96f-476a-af8b-bf719706b04d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:20.711605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e6587-e96f-476a-af8b-bf719706b04d admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:20.712587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e6587-e96f-476a-af8b-bf719706b04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:20.714759 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e6587-e96f-476a-af8b-bf719706b04d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:20.747780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 27/56] 10.222.0.62 () {60 vars in 1161 bytes} [Mon Dec 13 16:35:20 2021] POST /identity/v3/projects => generated 298 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:23.087538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03a341-a248-43d5-88b1-8258d102a58a None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:23.088473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03a341-a248-43d5-88b1-8258d102a58a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:23.088473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03a341-a248-43d5-88b1-8258d102a58a None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:23.091255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 30/57] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:23 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:23.098069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0aed1-7f5a-4d23-b4d3-ac19183b3ca6 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:23.098784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0aed1-7f5a-4d23-b4d3-ac19183b3ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:23.098911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0aed1-7f5a-4d23-b4d3-ac19183b3ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:23.120141 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-44e0aed1-7f5a-4d23-b4d3-ac19183b3ca6 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:23.121344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-44e0aed1-7f5a-4d23-b4d3-ac19183b3ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:23.183338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 28/58] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:23.208286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03a341-a248-43d5-88b1-8258d102a58a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:23.222561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03a341-a248-43d5-88b1-8258d102a58a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:23.228043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aacbf0-ab29-4cf6-a5e4-fa28f1123e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:23.228842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aacbf0-ab29-4cf6-a5e4-fa28f1123e1a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:23.229118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aacbf0-ab29-4cf6-a5e4-fa28f1123e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:23.229388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aacbf0-ab29-4cf6-a5e4-fa28f1123e1a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:23.230676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aacbf0-ab29-4cf6-a5e4-fa28f1123e1a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:23.232360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aacbf0-ab29-4cf6-a5e4-fa28f1123e1a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:23.233951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 31/59] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:23.240131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0aed1-7f5a-4d23-b4d3-ac19183b3ca6 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:23.255850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0aed1-7f5a-4d23-b4d3-ac19183b3ca6 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:23.263024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0c4b-9a33-49c1-847d-722a39f98c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:23.263692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0c4b-9a33-49c1-847d-722a39f98c41 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:23.263978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0c4b-9a33-49c1-847d-722a39f98c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:23.264251 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0c4b-9a33-49c1-847d-722a39f98c41 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:23.265018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e0c4b-9a33-49c1-847d-722a39f98c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:23.266076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-cd5e0c4b-9a33-49c1-847d-722a39f98c41 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:23.266076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:35:23.266076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:35:23.267957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e0c4b-9a33-49c1-847d-722a39f98c41 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:23.296639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 29/60] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:35:23 2021] POST /identity/v3/users => generated 275 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:26.759072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226b05-fd0b-4757-8573-8568abcb75e6 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:26.760017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226b05-fd0b-4757-8573-8568abcb75e6 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:26.760458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30226b05-fd0b-4757-8573-8568abcb75e6 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:26.762660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 32/61] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:26.773728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595a220-4837-4846-a5eb-3b4dc18a8799 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:26.774762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595a220-4837-4846-a5eb-3b4dc18a8799 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:26.775247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595a220-4837-4846-a5eb-3b4dc18a8799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:26.806394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-d595a220-4837-4846-a5eb-3b4dc18a8799 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:26.808021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d595a220-4837-4846-a5eb-3b4dc18a8799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:26.816237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 30/62] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:26.862094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226b05-fd0b-4757-8573-8568abcb75e6 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:26.877024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30226b05-fd0b-4757-8573-8568abcb75e6 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:26.886101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de3013-feba-479a-a434-5975e5009871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:26.887178 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de3013-feba-479a-a434-5975e5009871 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:26.887666 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de3013-feba-479a-a434-5975e5009871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:26.888157 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de3013-feba-479a-a434-5975e5009871 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:26.904263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de3013-feba-479a-a434-5975e5009871 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:26.911441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-f3de3013-feba-479a-a434-5975e5009871 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:26.912920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 33/63] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:26.919513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595a220-4837-4846-a5eb-3b4dc18a8799 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:26.929047 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595a220-4837-4846-a5eb-3b4dc18a8799 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:26.940290 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e06b84-8dd1-4196-b4e6-581b9fadf442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:26.941308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06b84-8dd1-4196-b4e6-581b9fadf442 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:26.941786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06b84-8dd1-4196-b4e6-581b9fadf442 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:26.942286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e06b84-8dd1-4196-b4e6-581b9fadf442 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:26.943266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e06b84-8dd1-4196-b4e6-581b9fadf442 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:26.943773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e06b84-8dd1-4196-b4e6-581b9fadf442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:26.945663 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e06b84-8dd1-4196-b4e6-581b9fadf442 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:26.960066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 31/64] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:26.966362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de3013-feba-479a-a434-5975e5009871 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:26.980625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de3013-feba-479a-a434-5975e5009871 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:26.990076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd07ca-fc0c-466e-90fb-904bdf254f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:26.991237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd07ca-fc0c-466e-90fb-904bdf254f93 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:26.991715 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd07ca-fc0c-466e-90fb-904bdf254f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:26.992177 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd07ca-fc0c-466e-90fb-904bdf254f93 admin admin] PATH_INFO: `/v3/users/413a785e94f448e88ffa0f0569dade74` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.010744 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd07ca-fc0c-466e-90fb-904bdf254f93 admin admin] RBAC: Authorizing `identity:get_user(user_id=413a785e94f448e88ffa0f0569dade74)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.013304 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd07ca-fc0c-466e-90fb-904bdf254f93 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.015266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 34/65] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:26 2021] GET /identity/v3/users/413a785e94f448e88ffa0f0569dade74 => generated 275 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.020168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e94d3-55b8-4a2e-bef4-5918595330b4 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.020729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e94d3-55b8-4a2e-bef4-5918595330b4 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.021217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e94d3-55b8-4a2e-bef4-5918595330b4 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.023199 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 32/66] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:27.024441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd07ca-fc0c-466e-90fb-904bdf254f93 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.029416 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8de60-d430-46a2-91bd-302e71982767 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.029931 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8de60-d430-46a2-91bd-302e71982767 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.030406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8de60-d430-46a2-91bd-302e71982767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.039677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd07ca-fc0c-466e-90fb-904bdf254f93 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.057797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-5ed8de60-d430-46a2-91bd-302e71982767 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:27.057974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63220470-6323-4634-966e-c1f7d66e4ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.058477 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63220470-6323-4634-966e-c1f7d66e4ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.058769 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63220470-6323-4634-966e-c1f7d66e4ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.059049 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63220470-6323-4634-966e-c1f7d66e4ed8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.060064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5ed8de60-d430-46a2-91bd-302e71982767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:27.070098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63220470-6323-4634-966e-c1f7d66e4ed8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.072940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63220470-6323-4634-966e-c1f7d66e4ed8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.074217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 33/67] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:27.075835 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081d3c1-b147-451c-adac-1cae7aff4aa7 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.076335 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081d3c1-b147-451c-adac-1cae7aff4aa7 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.076843 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081d3c1-b147-451c-adac-1cae7aff4aa7 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.078932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 34/68] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:27.088790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 35/69] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:27.091088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdcf4c-fef6-4c15-87db-d2b7f1d56d6c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.091088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdcf4c-fef6-4c15-87db-d2b7f1d56d6c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.091088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfdcf4c-fef6-4c15-87db-d2b7f1d56d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.095085 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63220470-6323-4634-966e-c1f7d66e4ed8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.106144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63220470-6323-4634-966e-c1f7d66e4ed8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.115675 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-3bfdcf4c-fef6-4c15-87db-d2b7f1d56d6c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:27.117353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3bfdcf4c-fef6-4c15-87db-d2b7f1d56d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:27.117556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0794c43-9cb0-4dd1-a508-59b7f81a79da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.118669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794c43-9cb0-4dd1-a508-59b7f81a79da admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.119099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794c43-9cb0-4dd1-a508-59b7f81a79da admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.119514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794c43-9cb0-4dd1-a508-59b7f81a79da admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.121032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0794c43-9cb0-4dd1-a508-59b7f81a79da admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.123266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0794c43-9cb0-4dd1-a508-59b7f81a79da admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.125117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 36/70] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.126022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0794c43-9cb0-4dd1-a508-59b7f81a79da admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.131904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 35/71] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:27.133557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdcf4c-fef6-4c15-87db-d2b7f1d56d6c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.144420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfdcf4c-fef6-4c15-87db-d2b7f1d56d6c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.150664 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb6d16-94c8-4034-8ab8-66d9c3f3d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.151727 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6d16-94c8-4034-8ab8-66d9c3f3d07d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.152165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6d16-94c8-4034-8ab8-66d9c3f3d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.152628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb6d16-94c8-4034-8ab8-66d9c3f3d07d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.153553 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0794c43-9cb0-4dd1-a508-59b7f81a79da admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.153765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb6d16-94c8-4034-8ab8-66d9c3f3d07d admin admin] RBAC: Adding query filter params (role.id=13af8820459545b2b1e4cea1afea8775, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5, user.id=413a785e94f448e88ffa0f0569dade74) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:27.154231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb6d16-94c8-4034-8ab8-66d9c3f3d07d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.156327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb6d16-94c8-4034-8ab8-66d9c3f3d07d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.162830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a85586-75f4-44d2-8e90-0ff28a909bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.163769 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a85586-75f4-44d2-8e90-0ff28a909bba admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.164252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a85586-75f4-44d2-8e90-0ff28a909bba admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.164911 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a85586-75f4-44d2-8e90-0ff28a909bba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.168702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 36/72] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/role_assignments?user.id=413a785e94f448e88ffa0f0569dade74&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=13af8820459545b2b1e4cea1afea8775 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.178813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb6d16-94c8-4034-8ab8-66d9c3f3d07d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.190085 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a85586-75f4-44d2-8e90-0ff28a909bba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:27.197582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a7a85586-75f4-44d2-8e90-0ff28a909bba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:35:27.199238 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 37/73] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:27.200596 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb6d16-94c8-4034-8ab8-66d9c3f3d07d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.206203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a85586-75f4-44d2-8e90-0ff28a909bba admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.216434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34815b65-3e3c-437e-9d5c-aab5e2a7afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.217758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34815b65-3e3c-437e-9d5c-aab5e2a7afa4 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.218265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34815b65-3e3c-437e-9d5c-aab5e2a7afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.219030 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34815b65-3e3c-437e-9d5c-aab5e2a7afa4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.221498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a85586-75f4-44d2-8e90-0ff28a909bba admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.235331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ea7e1-3669-4684-b6d1-6630170a4202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.236605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea7e1-3669-4684-b6d1-6630170a4202 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.237137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea7e1-3669-4684-b6d1-6630170a4202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.237618 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ea7e1-3669-4684-b6d1-6630170a4202 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.238619 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ea7e1-3669-4684-b6d1-6630170a4202 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:27.241716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ea7e1-3669-4684-b6d1-6630170a4202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.244097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ea7e1-3669-4684-b6d1-6630170a4202 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.246339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34815b65-3e3c-437e-9d5c-aab5e2a7afa4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:27.253829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-34815b65-3e3c-437e-9d5c-aab5e2a7afa4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:35:27.255071 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 38/75] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.260857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 37/75] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:35:27.260857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091ce0-1f2b-4068-b319-c9dcf169a2c4 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.260857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091ce0-1f2b-4068-b319-c9dcf169a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.260857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091ce0-1f2b-4068-b319-c9dcf169a2c4 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.260857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 38/76] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:27.264295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc091ce0-1f2b-4068-b319-c9dcf169a2c4 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.266750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789dfd-cd5f-4192-b324-cc1496f19292 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.266958 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789dfd-cd5f-4192-b324-cc1496f19292 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.267415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7789dfd-cd5f-4192-b324-cc1496f19292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.289169 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc091ce0-1f2b-4068-b319-c9dcf169a2c4 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.292192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f7789dfd-cd5f-4192-b324-cc1496f19292 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:27.293603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f7789dfd-cd5f-4192-b324-cc1496f19292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:27.294686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d91084-7ada-4edb-8ea4-47280a2b4cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.295803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d91084-7ada-4edb-8ea4-47280a2b4cba admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.296293 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d91084-7ada-4edb-8ea4-47280a2b4cba admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.296700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d91084-7ada-4edb-8ea4-47280a2b4cba admin admin] PATH_INFO: `/v3/users/bc88850011704653a832fe050d8d83ab` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.298265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d91084-7ada-4edb-8ea4-47280a2b4cba admin admin] RBAC: Authorizing `identity:get_user(user_id=bc88850011704653a832fe050d8d83ab)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.300475 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d91084-7ada-4edb-8ea4-47280a2b4cba admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.302602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 39/77] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:27.302925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 39/78] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/users/bc88850011704653a832fe050d8d83ab => generated 247 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.308965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7789dfd-cd5f-4192-b324-cc1496f19292 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.310451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d91084-7ada-4edb-8ea4-47280a2b4cba admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.325301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7789dfd-cd5f-4192-b324-cc1496f19292 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.330885 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffbb4c-f51b-40a9-95fa-3de69e11daec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.331439 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d91084-7ada-4edb-8ea4-47280a2b4cba admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.331587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffbb4c-f51b-40a9-95fa-3de69e11daec admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.332024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffbb4c-f51b-40a9-95fa-3de69e11daec admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.332430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ffbb4c-f51b-40a9-95fa-3de69e11daec admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.333636 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffbb4c-f51b-40a9-95fa-3de69e11daec admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:27.334200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffbb4c-f51b-40a9-95fa-3de69e11daec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.336417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ffbb4c-f51b-40a9-95fa-3de69e11daec admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.337239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb39be1-bc40-4d4f-bdf5-5dba6244db94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.338002 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39be1-bc40-4d4f-bdf5-5dba6244db94 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.338423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39be1-bc40-4d4f-bdf5-5dba6244db94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.338900 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb39be1-bc40-4d4f-bdf5-5dba6244db94 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.347689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 40/79] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.348346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb39be1-bc40-4d4f-bdf5-5dba6244db94 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.348553 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffbb4c-f51b-40a9-95fa-3de69e11daec admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.350722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb39be1-bc40-4d4f-bdf5-5dba6244db94 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.361301 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 40/80] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:27.362567 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb39be1-bc40-4d4f-bdf5-5dba6244db94 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.371892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ffbb4c-f51b-40a9-95fa-3de69e11daec admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.375252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb39be1-bc40-4d4f-bdf5-5dba6244db94 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.377710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ca0f4-e2ca-47a9-9e43-01ebfea79ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.378878 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca0f4-e2ca-47a9-9e43-01ebfea79ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.379390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca0f4-e2ca-47a9-9e43-01ebfea79ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.379893 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ca0f4-e2ca-47a9-9e43-01ebfea79ad7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.380445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac447d11-4929-4e85-a917-f54471777b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.381480 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447d11-4929-4e85-a917-f54471777b4c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.381893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447d11-4929-4e85-a917-f54471777b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.382271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac447d11-4929-4e85-a917-f54471777b4c admin admin] PATH_INFO: `/v3/users/413a785e94f448e88ffa0f0569dade74` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.384432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac447d11-4929-4e85-a917-f54471777b4c admin admin] RBAC: Authorizing `identity:get_user(user_id=413a785e94f448e88ffa0f0569dade74)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.387162 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac447d11-4929-4e85-a917-f54471777b4c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.389401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 41/81] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/users/413a785e94f448e88ffa0f0569dade74 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.395034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac447d11-4929-4e85-a917-f54471777b4c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.397285 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ca0f4-e2ca-47a9-9e43-01ebfea79ad7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:27.405517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac447d11-4929-4e85-a917-f54471777b4c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.406254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-369ca0f4-e2ca-47a9-9e43-01ebfea79ad7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:27.408425 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 41/82] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:27.409515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ca0f4-e2ca-47a9-9e43-01ebfea79ad7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.416668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d6bb-8ebd-4d13-88ce-ed69a1ef5c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.418229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d6bb-8ebd-4d13-88ce-ed69a1ef5c54 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.418564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d6bb-8ebd-4d13-88ce-ed69a1ef5c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.418844 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66d6bb-8ebd-4d13-88ce-ed69a1ef5c54 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.420401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66d6bb-8ebd-4d13-88ce-ed69a1ef5c54 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.422122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ca0f4-e2ca-47a9-9e43-01ebfea79ad7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.422622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66d6bb-8ebd-4d13-88ce-ed69a1ef5c54 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.424470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 42/83] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.425528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d6bb-8ebd-4d13-88ce-ed69a1ef5c54 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.435129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd93b88-483e-414d-b152-779fe4e709a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.435903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93b88-483e-414d-b152-779fe4e709a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.436254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93b88-483e-414d-b152-779fe4e709a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.436685 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93b88-483e-414d-b152-779fe4e709a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.440725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66d6bb-8ebd-4d13-88ce-ed69a1ef5c54 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.445356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd93b88-483e-414d-b152-779fe4e709a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.446698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc206747-3841-4d3c-8f0b-80249b86b20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.447588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc206747-3841-4d3c-8f0b-80249b86b20f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.448015 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd93b88-483e-414d-b152-779fe4e709a5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.448225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc206747-3841-4d3c-8f0b-80249b86b20f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.448700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc206747-3841-4d3c-8f0b-80249b86b20f admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.449624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc206747-3841-4d3c-8f0b-80249b86b20f admin admin] RBAC: Adding query filter params (name=member) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:27.450114 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc206747-3841-4d3c-8f0b-80249b86b20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.451887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc206747-3841-4d3c-8f0b-80249b86b20f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.458244 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 42/84] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:27.459140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd93b88-483e-414d-b152-779fe4e709a5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.461978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 43/85] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.473276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc206747-3841-4d3c-8f0b-80249b86b20f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.475869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd93b88-483e-414d-b152-779fe4e709a5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.481409 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb365e-8087-4b21-9e05-9754ad9f8921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.482515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb365e-8087-4b21-9e05-9754ad9f8921 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.482962 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb365e-8087-4b21-9e05-9754ad9f8921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.483477 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb365e-8087-4b21-9e05-9754ad9f8921 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.484501 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb365e-8087-4b21-9e05-9754ad9f8921 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5, user.id=bc88850011704653a832fe050d8d83ab) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:27.484979 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb365e-8087-4b21-9e05-9754ad9f8921 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.485086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc206747-3841-4d3c-8f0b-80249b86b20f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.486319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-f0bb365e-8087-4b21-9e05-9754ad9f8921 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:27.486319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:35:27.486319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:35:27.487975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb365e-8087-4b21-9e05-9754ad9f8921 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.490540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de611f-d1e6-4bce-8a4f-335c4beb6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.491607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de611f-d1e6-4bce-8a4f-335c4beb6314 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.491960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de611f-d1e6-4bce-8a4f-335c4beb6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.492306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de611f-d1e6-4bce-8a4f-335c4beb6314 admin admin] PATH_INFO: `/v3/users/413a785e94f448e88ffa0f0569dade74` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.493821 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de611f-d1e6-4bce-8a4f-335c4beb6314 admin admin] RBAC: Authorizing `identity:get_user(user_id=413a785e94f448e88ffa0f0569dade74)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.496117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de611f-d1e6-4bce-8a4f-335c4beb6314 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.500604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 44/86] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/users/413a785e94f448e88ffa0f0569dade74 => generated 275 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.500604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de611f-d1e6-4bce-8a4f-335c4beb6314 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.500829 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 43/87] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/role_assignments?user.id=bc88850011704653a832fe050d8d83ab&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=f3311ba27a464113b884aa5a1144945d => generated 259 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.514917 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de611f-d1e6-4bce-8a4f-335c4beb6314 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.515814 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb365e-8087-4b21-9e05-9754ad9f8921 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.528382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb365e-8087-4b21-9e05-9754ad9f8921 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.533648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb1e1d-d6e9-4eb7-bebf-05f77fd03b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.535531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb1e1d-d6e9-4eb7-bebf-05f77fd03b25 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.537280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb1e1d-d6e9-4eb7-bebf-05f77fd03b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.537604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb1e1d-d6e9-4eb7-bebf-05f77fd03b25 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.538518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aca333-83f3-421c-8c76-d6bdf28660e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.539243 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aca333-83f3-421c-8c76-d6bdf28660e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.539526 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aca333-83f3-421c-8c76-d6bdf28660e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.540459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb1e1d-d6e9-4eb7-bebf-05f77fd03b25 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.541086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aca333-83f3-421c-8c76-d6bdf28660e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.544145 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb1e1d-d6e9-4eb7-bebf-05f77fd03b25 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.550434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 45/88] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.555063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aca333-83f3-421c-8c76-d6bdf28660e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.557188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb1e1d-d6e9-4eb7-bebf-05f77fd03b25 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.563494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aca333-83f3-421c-8c76-d6bdf28660e7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.571945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb1e1d-d6e9-4eb7-bebf-05f77fd03b25 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.579580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 44/89] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 13 16:35:27.590249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aca333-83f3-421c-8c76-d6bdf28660e7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.591840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de46c-4ae8-4745-a80b-314f1277b953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.598027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de46c-4ae8-4745-a80b-314f1277b953 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.598027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de46c-4ae8-4745-a80b-314f1277b953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.598027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061de46c-4ae8-4745-a80b-314f1277b953 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.598933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de46c-4ae8-4745-a80b-314f1277b953 admin admin] RBAC: Adding query filter params (role.id=aa4c4022e45a4188814d7840a56322eb, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5, user.id=413a785e94f448e88ffa0f0569dade74) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:27.599247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de46c-4ae8-4745-a80b-314f1277b953 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.601241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061de46c-4ae8-4745-a80b-314f1277b953 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.602978 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aca333-83f3-421c-8c76-d6bdf28660e7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.616820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d2e6e-9092-4b36-8cb4-26c365a2111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.618311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d2e6e-9092-4b36-8cb4-26c365a2111a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.618903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 46/90] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/role_assignments?user.id=413a785e94f448e88ffa0f0569dade74&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=aa4c4022e45a4188814d7840a56322eb => generated 259 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:27.619434 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d2e6e-9092-4b36-8cb4-26c365a2111a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.619910 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d2e6e-9092-4b36-8cb4-26c365a2111a admin admin] PATH_INFO: `/v3/projects/2a6ac833d486473b9e97f0ed5b6fe38f` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.625616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d2e6e-9092-4b36-8cb4-26c365a2111a admin admin] RBAC: Authorizing `identity:get_project(project_id=2a6ac833d486473b9e97f0ed5b6fe38f)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.628097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d2e6e-9092-4b36-8cb4-26c365a2111a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.630495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 45/91] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/projects/2a6ac833d486473b9e97f0ed5b6fe38f => generated 312 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.636947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de46c-4ae8-4745-a80b-314f1277b953 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.642541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7216563-fdf8-45c2-b677-e6eaaf1d9a8f None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.643028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7216563-fdf8-45c2-b677-e6eaaf1d9a8f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.643128 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7216563-fdf8-45c2-b677-e6eaaf1d9a8f None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.648499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061de46c-4ae8-4745-a80b-314f1277b953 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.649486 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 46/92] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:27 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:27.656424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5113b-eee5-49aa-b6fa-e1683b4ec05f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.656794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5113b-eee5-49aa-b6fa-e1683b4ec05f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.657018 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5113b-eee5-49aa-b6fa-e1683b4ec05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.665643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52262e9b-eea9-4895-8516-7b56d35229e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.666296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52262e9b-eea9-4895-8516-7b56d35229e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.666579 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52262e9b-eea9-4895-8516-7b56d35229e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.666855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52262e9b-eea9-4895-8516-7b56d35229e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.667733 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52262e9b-eea9-4895-8516-7b56d35229e2 admin admin] RBAC: Adding query filter params (role.id=13af8820459545b2b1e4cea1afea8775, scope.project.id=2a6ac833d486473b9e97f0ed5b6fe38f, user.id=413a785e94f448e88ffa0f0569dade74) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:27.668045 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52262e9b-eea9-4895-8516-7b56d35229e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.670075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52262e9b-eea9-4895-8516-7b56d35229e2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.683958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 47/93] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/role_assignments?user.id=413a785e94f448e88ffa0f0569dade74&scope.project.id=2a6ac833d486473b9e97f0ed5b6fe38f&role.id=13af8820459545b2b1e4cea1afea8775 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.697832 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-58a5113b-eee5-49aa-b6fa-e1683b4ec05f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:27.698836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-58a5113b-eee5-49aa-b6fa-e1683b4ec05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:27.710596 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 47/94] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:27.736232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52262e9b-eea9-4895-8516-7b56d35229e2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.747082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52262e9b-eea9-4895-8516-7b56d35229e2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.760476 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda6e01-5660-448d-8e7b-178615df5f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.761353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda6e01-5660-448d-8e7b-178615df5f70 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.761636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda6e01-5660-448d-8e7b-178615df5f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.761911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda6e01-5660-448d-8e7b-178615df5f70 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.769815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda6e01-5660-448d-8e7b-178615df5f70 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.771607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda6e01-5660-448d-8e7b-178615df5f70 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.773824 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 48/95] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:27.780771 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5113b-eee5-49aa-b6fa-e1683b4ec05f None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:27.793416 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5113b-eee5-49aa-b6fa-e1683b4ec05f None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:27.800979 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bffe64-0437-4144-9c54-80d6b878d4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:27.801691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffe64-0437-4144-9c54-80d6b878d4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:27.801980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffe64-0437-4144-9c54-80d6b878d4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:27.802262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bffe64-0437-4144-9c54-80d6b878d4f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:27.803026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bffe64-0437-4144-9c54-80d6b878d4f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:27.804181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-c2bffe64-0437-4144-9c54-80d6b878d4f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:27.804181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:35:27.804181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:35:27.805569 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bffe64-0437-4144-9c54-80d6b878d4f6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:27.842689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 48/96] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:35:27 2021] POST /identity/v3/users => generated 289 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:29.830988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22400d-dd35-4224-84e7-eb778be43e8a None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:29.831545 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22400d-dd35-4224-84e7-eb778be43e8a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:29.831545 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22400d-dd35-4224-84e7-eb778be43e8a None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:29.833376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 49/97] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:29.840249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74addb3f-1980-410b-8928-aee4d78281ce None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:29.840797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74addb3f-1980-410b-8928-aee4d78281ce None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:29.840797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74addb3f-1980-410b-8928-aee4d78281ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:29.867115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-74addb3f-1980-410b-8928-aee4d78281ce None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:29.868909 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-74addb3f-1980-410b-8928-aee4d78281ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:29.882700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 49/98] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:29 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:29.923197 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22400d-dd35-4224-84e7-eb778be43e8a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:29.945253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa22400d-dd35-4224-84e7-eb778be43e8a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:29.950281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fd78f-e622-4259-a96e-678cfe606e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:29.951141 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd78f-e622-4259-a96e-678cfe606e23 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:29.951422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd78f-e622-4259-a96e-678cfe606e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:29.951684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fd78f-e622-4259-a96e-678cfe606e23 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:29.966461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fd78f-e622-4259-a96e-678cfe606e23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:29.979596 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-8e2fd78f-e622-4259-a96e-678cfe606e23 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:29.981035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 50/99] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:29.987179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74addb3f-1980-410b-8928-aee4d78281ce None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:30.001564 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74addb3f-1980-410b-8928-aee4d78281ce None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:30.008633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d443498-6e48-4c5a-8f74-d61e5b5edde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:30.009559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443498-6e48-4c5a-8f74-d61e5b5edde8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.010034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443498-6e48-4c5a-8f74-d61e5b5edde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.010492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d443498-6e48-4c5a-8f74-d61e5b5edde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.011500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d443498-6e48-4c5a-8f74-d61e5b5edde8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:30.011999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d443498-6e48-4c5a-8f74-d61e5b5edde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:30.013860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d443498-6e48-4c5a-8f74-d61e5b5edde8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:30.028495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 50/100] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:30.034348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fd78f-e622-4259-a96e-678cfe606e23 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:30.044952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fd78f-e622-4259-a96e-678cfe606e23 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:30.056364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5086dd5-6bdc-4bba-9704-8c22872870cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:30.057277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5086dd5-6bdc-4bba-9704-8c22872870cb admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.057562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5086dd5-6bdc-4bba-9704-8c22872870cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.057837 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5086dd5-6bdc-4bba-9704-8c22872870cb admin admin] PATH_INFO: `/v3/users/413a785e94f448e88ffa0f0569dade74` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.065326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5086dd5-6bdc-4bba-9704-8c22872870cb admin admin] RBAC: Authorizing `identity:get_user(user_id=413a785e94f448e88ffa0f0569dade74)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:30.067481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5086dd5-6bdc-4bba-9704-8c22872870cb admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:30.069148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 51/101] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:30 2021] GET /identity/v3/users/413a785e94f448e88ffa0f0569dade74 => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:30.075424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d443498-6e48-4c5a-8f74-d61e5b5edde8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:30.090022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d443498-6e48-4c5a-8f74-d61e5b5edde8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:30.098966 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2c09bf-1ab1-4c71-aba9-7d58b68ab5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:30.100074 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c09bf-1ab1-4c71-aba9-7d58b68ab5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.100560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c09bf-1ab1-4c71-aba9-7d58b68ab5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.101044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2c09bf-1ab1-4c71-aba9-7d58b68ab5e5 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.105296 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c09bf-1ab1-4c71-aba9-7d58b68ab5e5 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:30.107988 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2c09bf-1ab1-4c71-aba9-7d58b68ab5e5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:30.109894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 51/102] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:30 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:30.116040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5086dd5-6bdc-4bba-9704-8c22872870cb admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:30.131555 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5086dd5-6bdc-4bba-9704-8c22872870cb admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:30.136515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688ad80-f138-4fc9-ad8f-578199d72b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:30.137440 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688ad80-f138-4fc9-ad8f-578199d72b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.137716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688ad80-f138-4fc9-ad8f-578199d72b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.137989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688ad80-f138-4fc9-ad8f-578199d72b9e admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/users/413a785e94f448e88ffa0f0569dade74/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.145967 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688ad80-f138-4fc9-ad8f-578199d72b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c905a70f0f4dc58022cf7d31f2b3c5, user_id=413a785e94f448e88ffa0f0569dade74, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:30.148645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8688ad80-f138-4fc9-ad8f-578199d72b9e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:30.177475 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 52/103] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:35:30 2021] PUT /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/users/413a785e94f448e88ffa0f0569dade74/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:35:30.302326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf0034-9402-438d-88b9-8ae6d019a529 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.302961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf0034-9402-438d-88b9-8ae6d019a529 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.303435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf0034-9402-438d-88b9-8ae6d019a529 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.305887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 52/104] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:30.324054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f0c9a-a29b-4ea6-b09f-0b9d826bed10 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.324343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f0c9a-a29b-4ea6-b09f-0b9d826bed10 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.324646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5f0c9a-a29b-4ea6-b09f-0b9d826bed10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.356368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-4a5f0c9a-a29b-4ea6-b09f-0b9d826bed10 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:30.357484 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4a5f0c9a-a29b-4ea6-b09f-0b9d826bed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:30.428665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 53/105] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:30.468532 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf0034-9402-438d-88b9-8ae6d019a529 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:30.488013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf0034-9402-438d-88b9-8ae6d019a529 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:30.496313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca960d-c977-4a36-8775-1f5937029d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:30.497590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca960d-c977-4a36-8775-1f5937029d82 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.498081 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca960d-c977-4a36-8775-1f5937029d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.498542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca960d-c977-4a36-8775-1f5937029d82 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.521520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca960d-c977-4a36-8775-1f5937029d82 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:30.529389 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-f1ca960d-c977-4a36-8775-1f5937029d82 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:35:30.531402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 53/106] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:35:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:30.538130 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f0c9a-a29b-4ea6-b09f-0b9d826bed10 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:30.556829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5f0c9a-a29b-4ea6-b09f-0b9d826bed10 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:30.563983 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027d9da-664b-4117-a0ed-ead0caa8ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:30.564704 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d9da-664b-4117-a0ed-ead0caa8ad1b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.564984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d9da-664b-4117-a0ed-ead0caa8ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.565252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d9da-664b-4117-a0ed-ead0caa8ad1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.566023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027d9da-664b-4117-a0ed-ead0caa8ad1b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:30.566326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027d9da-664b-4117-a0ed-ead0caa8ad1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:30.567971 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027d9da-664b-4117-a0ed-ead0caa8ad1b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:30.579869 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 54/107] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:35:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:30.586012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca960d-c977-4a36-8775-1f5937029d82 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:30.600094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca960d-c977-4a36-8775-1f5937029d82 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:30.607517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c797f-f7be-4b3f-8096-1cf047afb95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:30.608721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c797f-f7be-4b3f-8096-1cf047afb95e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.609197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c797f-f7be-4b3f-8096-1cf047afb95e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.609657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4c797f-f7be-4b3f-8096-1cf047afb95e admin admin] PATH_INFO: `/v3/users/413a785e94f448e88ffa0f0569dade74` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.617383 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c797f-f7be-4b3f-8096-1cf047afb95e admin admin] RBAC: Authorizing `identity:get_user(user_id=413a785e94f448e88ffa0f0569dade74)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:30.619890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4c797f-f7be-4b3f-8096-1cf047afb95e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:30.621848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 54/108] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:30 2021] GET /identity/v3/users/413a785e94f448e88ffa0f0569dade74 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:30.628137 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027d9da-664b-4117-a0ed-ead0caa8ad1b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:30.638349 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027d9da-664b-4117-a0ed-ead0caa8ad1b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:30.649037 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89700e65-02dc-45b3-854a-c96d50615c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:30.650142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89700e65-02dc-45b3-854a-c96d50615c11 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.650426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89700e65-02dc-45b3-854a-c96d50615c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.650704 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89700e65-02dc-45b3-854a-c96d50615c11 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.657405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89700e65-02dc-45b3-854a-c96d50615c11 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:30.659531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89700e65-02dc-45b3-854a-c96d50615c11 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:30.661361 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 55/109] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:30 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:30.667864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c797f-f7be-4b3f-8096-1cf047afb95e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:30.680096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4c797f-f7be-4b3f-8096-1cf047afb95e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:30.684956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87783f3d-0ff6-4bce-9155-33562c87a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:30.686058 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783f3d-0ff6-4bce-9155-33562c87a48e admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.686525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783f3d-0ff6-4bce-9155-33562c87a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.687002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783f3d-0ff6-4bce-9155-33562c87a48e admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/users/413a785e94f448e88ffa0f0569dade74/roles/aa4c4022e45a4188814d7840a56322eb` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.689542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87783f3d-0ff6-4bce-9155-33562c87a48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c905a70f0f4dc58022cf7d31f2b3c5, user_id=413a785e94f448e88ffa0f0569dade74, role_id=aa4c4022e45a4188814d7840a56322eb)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:30.690761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-87783f3d-0ff6-4bce-9155-33562c87a48e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:30.690761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:35:30.690761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:35:30.697225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87783f3d-0ff6-4bce-9155-33562c87a48e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:30.732341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 55/110] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:35:30 2021] PUT /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/users/413a785e94f448e88ffa0f0569dade74/roles/aa4c4022e45a4188814d7840a56322eb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:35:30.915527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc77f4-79b9-4b58-aa56-e8bbc9de4717 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.916598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc77f4-79b9-4b58-aa56-e8bbc9de4717 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.917088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc77f4-79b9-4b58-aa56-e8bbc9de4717 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.919064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 56/111] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:30.925620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809975-7824-47ba-b153-89ca408c9c06 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:30.926097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809975-7824-47ba-b153-89ca408c9c06 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:30.926165 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69809975-7824-47ba-b153-89ca408c9c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:30.948916 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-69809975-7824-47ba-b153-89ca408c9c06 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:30.950194 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-69809975-7824-47ba-b153-89ca408c9c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:31.009365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e037a-c482-45bd-897e-0c2c4e724e44 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.010871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e037a-c482-45bd-897e-0c2c4e724e44 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.011353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e037a-c482-45bd-897e-0c2c4e724e44 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.014178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 57/112] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:31 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:31.029483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 56/113] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:31.031879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d8a9-c838-45fd-a1a4-91c53de4eedf None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.032379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d8a9-c838-45fd-a1a4-91c53de4eedf None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.032877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07d8a9-c838-45fd-a1a4-91c53de4eedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.069716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69809975-7824-47ba-b153-89ca408c9c06 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:31.069933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9f07d8a9-c838-45fd-a1a4-91c53de4eedf None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:31.071094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9f07d8a9-c838-45fd-a1a4-91c53de4eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:31.085527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 58/114] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:31.086831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69809975-7824-47ba-b153-89ca408c9c06 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:31.094188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9a9be-deda-4060-b1c2-59524f54c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:31.095128 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a9be-deda-4060-b1c2-59524f54c5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.095412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a9be-deda-4060-b1c2-59524f54c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.095692 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9a9be-deda-4060-b1c2-59524f54c5b9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.118126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9a9be-deda-4060-b1c2-59524f54c5b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:31.123850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07d8a9-c838-45fd-a1a4-91c53de4eedf None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:31.125711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-c0a9a9be-deda-4060-b1c2-59524f54c5b9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:35:31.132402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 57/115] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:35:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:35:31.134051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9a9be-deda-4060-b1c2-59524f54c5b9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:31.140277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07d8a9-c838-45fd-a1a4-91c53de4eedf None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:31.151210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9a9be-deda-4060-b1c2-59524f54c5b9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:31.154032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc073e-4363-45ff-8f65-a43e6b241746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:31.154863 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc073e-4363-45ff-8f65-a43e6b241746 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.155147 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc073e-4363-45ff-8f65-a43e6b241746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.155419 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc073e-4363-45ff-8f65-a43e6b241746 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.162923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5d2b8-69b3-4058-889d-60c0fb36b1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:31.163604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5d2b8-69b3-4058-889d-60c0fb36b1b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.163890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5d2b8-69b3-4058-889d-60c0fb36b1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.164154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5d2b8-69b3-4058-889d-60c0fb36b1b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.165064 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5d2b8-69b3-4058-889d-60c0fb36b1b5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:31.165369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5d2b8-69b3-4058-889d-60c0fb36b1b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:31.167078 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5d2b8-69b3-4058-889d-60c0fb36b1b5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:31.179019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc073e-4363-45ff-8f65-a43e6b241746 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:31.185935 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-56bc073e-4363-45ff-8f65-a43e6b241746 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:31.187466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 59/116] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:31.192174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 58/117] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:31.193886 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc073e-4363-45ff-8f65-a43e6b241746 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:31.198300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5d2b8-69b3-4058-889d-60c0fb36b1b5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:31.206729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc073e-4363-45ff-8f65-a43e6b241746 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:31.213666 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5d2b8-69b3-4058-889d-60c0fb36b1b5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:31.217798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37153bf3-de87-4c29-9e9d-1dd501b408a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:31.218468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37153bf3-de87-4c29-9e9d-1dd501b408a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.218749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37153bf3-de87-4c29-9e9d-1dd501b408a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.219021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37153bf3-de87-4c29-9e9d-1dd501b408a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.219787 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37153bf3-de87-4c29-9e9d-1dd501b408a5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:31.220091 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37153bf3-de87-4c29-9e9d-1dd501b408a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:31.221726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37153bf3-de87-4c29-9e9d-1dd501b408a5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:31.230764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08fdc6-1996-437d-af24-4bb241e41320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:31.231644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08fdc6-1996-437d-af24-4bb241e41320 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.231922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08fdc6-1996-437d-af24-4bb241e41320 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.232195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08fdc6-1996-437d-af24-4bb241e41320 admin admin] PATH_INFO: `/v3/users/bc88850011704653a832fe050d8d83ab` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.234489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08fdc6-1996-437d-af24-4bb241e41320 admin admin] RBAC: Authorizing `identity:get_user(user_id=bc88850011704653a832fe050d8d83ab)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:31.236318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08fdc6-1996-437d-af24-4bb241e41320 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:31.238127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 59/118] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:31 2021] GET /identity/v3/users/bc88850011704653a832fe050d8d83ab => generated 247 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:31.240205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 60/119] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:31.244515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08fdc6-1996-437d-af24-4bb241e41320 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:31.256585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37153bf3-de87-4c29-9e9d-1dd501b408a5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:31.266868 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37153bf3-de87-4c29-9e9d-1dd501b408a5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:31.267849 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08fdc6-1996-437d-af24-4bb241e41320 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:31.275154 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936dad3-7381-4b36-b810-d07dfcb986da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:31.276027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936dad3-7381-4b36-b810-d07dfcb986da admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.276306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936dad3-7381-4b36-b810-d07dfcb986da admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.276591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936dad3-7381-4b36-b810-d07dfcb986da admin admin] PATH_INFO: `/v3/users/413a785e94f448e88ffa0f0569dade74` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.277641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645701-e220-4ab2-8f4a-fe3ac2d3b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:31.278511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645701-e220-4ab2-8f4a-fe3ac2d3b6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.278765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645701-e220-4ab2-8f4a-fe3ac2d3b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.279034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39645701-e220-4ab2-8f4a-fe3ac2d3b6c3 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.280188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936dad3-7381-4b36-b810-d07dfcb986da admin admin] RBAC: Authorizing `identity:get_user(user_id=413a785e94f448e88ffa0f0569dade74)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:31.282369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936dad3-7381-4b36-b810-d07dfcb986da admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:31.284165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 61/120] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:31 2021] GET /identity/v3/users/413a785e94f448e88ffa0f0569dade74 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:31.284716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39645701-e220-4ab2-8f4a-fe3ac2d3b6c3 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:31.286833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39645701-e220-4ab2-8f4a-fe3ac2d3b6c3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:31.288656 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 60/121] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:31 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:31.292219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936dad3-7381-4b36-b810-d07dfcb986da admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:31.295129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645701-e220-4ab2-8f4a-fe3ac2d3b6c3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:31.306846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39645701-e220-4ab2-8f4a-fe3ac2d3b6c3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:31.309536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936dad3-7381-4b36-b810-d07dfcb986da admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:31.318525 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28475170-43b3-4da1-b7ab-ebf792d10bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:31.319393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475170-43b3-4da1-b7ab-ebf792d10bae admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.319679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475170-43b3-4da1-b7ab-ebf792d10bae admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.319955 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28475170-43b3-4da1-b7ab-ebf792d10bae admin admin] PATH_INFO: `/v3/projects/2a6ac833d486473b9e97f0ed5b6fe38f` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.325236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5bd5a-0e8b-48cd-b106-b36fd7be8395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:31.325436 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28475170-43b3-4da1-b7ab-ebf792d10bae admin admin] RBAC: Authorizing `identity:get_project(project_id=2a6ac833d486473b9e97f0ed5b6fe38f)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:31.326153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5bd5a-0e8b-48cd-b106-b36fd7be8395 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.326435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5bd5a-0e8b-48cd-b106-b36fd7be8395 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.326711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5bd5a-0e8b-48cd-b106-b36fd7be8395 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/users/bc88850011704653a832fe050d8d83ab/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.327529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28475170-43b3-4da1-b7ab-ebf792d10bae admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:31.328739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5bd5a-0e8b-48cd-b106-b36fd7be8395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c905a70f0f4dc58022cf7d31f2b3c5, user_id=bc88850011704653a832fe050d8d83ab, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:31.329390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 62/122] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:31 2021] GET /identity/v3/projects/2a6ac833d486473b9e97f0ed5b6fe38f => generated 312 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:31.331391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5bd5a-0e8b-48cd-b106-b36fd7be8395 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:31.336047 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28475170-43b3-4da1-b7ab-ebf792d10bae admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:31.354959 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28475170-43b3-4da1-b7ab-ebf792d10bae admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:31.360872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 61/123] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:35:31 2021] PUT /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/users/bc88850011704653a832fe050d8d83ab/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:35:31.456741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918bb0f2-1548-4bd6-8968-232b6d16a9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:31.458084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bb0f2-1548-4bd6-8968-232b6d16a9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:31.458624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bb0f2-1548-4bd6-8968-232b6d16a9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:31.459098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918bb0f2-1548-4bd6-8968-232b6d16a9dc admin admin] PATH_INFO: `/v3/projects/2a6ac833d486473b9e97f0ed5b6fe38f/users/413a785e94f448e88ffa0f0569dade74/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:31.461663 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bb0f2-1548-4bd6-8968-232b6d16a9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6ac833d486473b9e97f0ed5b6fe38f, user_id=413a785e94f448e88ffa0f0569dade74, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:31.464892 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918bb0f2-1548-4bd6-8968-232b6d16a9dc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:31.489725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 63/124] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:35:31 2021] PUT /identity/v3/projects/2a6ac833d486473b9e97f0ed5b6fe38f/users/413a785e94f448e88ffa0f0569dade74/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:35:32.254844 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f50733-00d5-47da-b9e1-e09cb9368b34 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.255376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f50733-00d5-47da-b9e1-e09cb9368b34 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.255376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f50733-00d5-47da-b9e1-e09cb9368b34 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.257561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 62/125] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:32.263767 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dcb15-2815-4f00-9d30-d4f905b104c0 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.264730 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dcb15-2815-4f00-9d30-d4f905b104c0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.265201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dcb15-2815-4f00-9d30-d4f905b104c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.289747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-0c4dcb15-2815-4f00-9d30-d4f905b104c0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:32.291318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0c4dcb15-2815-4f00-9d30-d4f905b104c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:32.361451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 64/126] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:32.405027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f50733-00d5-47da-b9e1-e09cb9368b34 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:32.421493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f50733-00d5-47da-b9e1-e09cb9368b34 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:32.426199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b26018-5d1c-4f1a-a3e1-306eb0c8b916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:32.426992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b26018-5d1c-4f1a-a3e1-306eb0c8b916 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.427273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b26018-5d1c-4f1a-a3e1-306eb0c8b916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.427542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b26018-5d1c-4f1a-a3e1-306eb0c8b916 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.449717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b26018-5d1c-4f1a-a3e1-306eb0c8b916 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:32.456589 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-19b26018-5d1c-4f1a-a3e1-306eb0c8b916 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 13 16:35:32.458170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 63/127] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:32 2021] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:32.464437 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dcb15-2815-4f00-9d30-d4f905b104c0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:32.477312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dcb15-2815-4f00-9d30-d4f905b104c0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:32.487432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed7281-401a-4b5d-bf49-822e184b85ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:32.488339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed7281-401a-4b5d-bf49-822e184b85ce admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.488860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed7281-401a-4b5d-bf49-822e184b85ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.489339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed7281-401a-4b5d-bf49-822e184b85ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.490289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed7281-401a-4b5d-bf49-822e184b85ce admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:32.490779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed7281-401a-4b5d-bf49-822e184b85ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:32.492747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed7281-401a-4b5d-bf49-822e184b85ce admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:32.506952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 65/128] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:32 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:32.512971 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b26018-5d1c-4f1a-a3e1-306eb0c8b916 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:32.523720 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b26018-5d1c-4f1a-a3e1-306eb0c8b916 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:32.535445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc7e30-920e-4fbe-8b1b-8b45cab6f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:32.536373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7e30-920e-4fbe-8b1b-8b45cab6f3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.536673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7e30-920e-4fbe-8b1b-8b45cab6f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.536942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc7e30-920e-4fbe-8b1b-8b45cab6f3c2 admin admin] PATH_INFO: `/v3/users/1ad52b11880742c48abf5eed9474fd41` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.557275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc7e30-920e-4fbe-8b1b-8b45cab6f3c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ad52b11880742c48abf5eed9474fd41)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:32.559462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc7e30-920e-4fbe-8b1b-8b45cab6f3c2 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:32.561334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 64/129] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:32 2021] GET /identity/v3/users/1ad52b11880742c48abf5eed9474fd41 => generated 289 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:32.567397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed7281-401a-4b5d-bf49-822e184b85ce admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:32.581374 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed7281-401a-4b5d-bf49-822e184b85ce admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:32.594014 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38aa4-9cb5-4b92-bcf4-23f694030fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:32.594667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38aa4-9cb5-4b92-bcf4-23f694030fdf admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.594951 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38aa4-9cb5-4b92-bcf4-23f694030fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.595232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38aa4-9cb5-4b92-bcf4-23f694030fdf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.607983 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc38aa4-9cb5-4b92-bcf4-23f694030fdf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:32.609812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc38aa4-9cb5-4b92-bcf4-23f694030fdf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:32.622932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 66/130] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:32 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:32.629076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc7e30-920e-4fbe-8b1b-8b45cab6f3c2 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:32.638960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc7e30-920e-4fbe-8b1b-8b45cab6f3c2 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:32.648545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b15397-cc0e-4509-90d0-44fd4bfbde5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:32.649502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b15397-cc0e-4509-90d0-44fd4bfbde5b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.649785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b15397-cc0e-4509-90d0-44fd4bfbde5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.650065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b15397-cc0e-4509-90d0-44fd4bfbde5b admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.653504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b15397-cc0e-4509-90d0-44fd4bfbde5b admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:32.655600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b15397-cc0e-4509-90d0-44fd4bfbde5b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:32.657651 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 65/131] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:32 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:32.663777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38aa4-9cb5-4b92-bcf4-23f694030fdf admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:32.677713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc38aa4-9cb5-4b92-bcf4-23f694030fdf admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:32.684742 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d95087f-2213-4e9e-8668-57c507c4468f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:32.685407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95087f-2213-4e9e-8668-57c507c4468f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.685698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95087f-2213-4e9e-8668-57c507c4468f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.685976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d95087f-2213-4e9e-8668-57c507c4468f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.686832 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95087f-2213-4e9e-8668-57c507c4468f admin admin] RBAC: Adding query filter params (role.id=59ca0f318c444b35add02b8d1f75c421, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5, user.id=1ad52b11880742c48abf5eed9474fd41) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:32.687146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95087f-2213-4e9e-8668-57c507c4468f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:32.689061 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d95087f-2213-4e9e-8668-57c507c4468f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:32.700825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 67/132] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:32 2021] GET /identity/v3/role_assignments?user.id=1ad52b11880742c48abf5eed9474fd41&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=59ca0f318c444b35add02b8d1f75c421 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:32.845080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979035b5-85e3-4531-a054-47f3aac0b02f None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.845264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979035b5-85e3-4531-a054-47f3aac0b02f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.845544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979035b5-85e3-4531-a054-47f3aac0b02f None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.847575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 66/133] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:32.854514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819147cc-8d3c-40db-9371-d8ff5f62f892 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.854861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819147cc-8d3c-40db-9371-d8ff5f62f892 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.855070 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819147cc-8d3c-40db-9371-d8ff5f62f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.885882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-819147cc-8d3c-40db-9371-d8ff5f62f892 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:32.887106 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-819147cc-8d3c-40db-9371-d8ff5f62f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:32.895471 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 68/134] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:32 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:32.933113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979035b5-85e3-4531-a054-47f3aac0b02f None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:32.949799 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979035b5-85e3-4531-a054-47f3aac0b02f None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:32.958072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876ab19-24a8-4ddd-b539-e6d2ea9fe2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:32.958938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ab19-24a8-4ddd-b539-e6d2ea9fe2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.959220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ab19-24a8-4ddd-b539-e6d2ea9fe2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.959494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876ab19-24a8-4ddd-b539-e6d2ea9fe2e1 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.960818 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876ab19-24a8-4ddd-b539-e6d2ea9fe2e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:32.962620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876ab19-24a8-4ddd-b539-e6d2ea9fe2e1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:32.964549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 67/135] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:32 2021] GET /identity/v3/domains/default => generated 199 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:32.971141 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819147cc-8d3c-40db-9371-d8ff5f62f892 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:32.982619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819147cc-8d3c-40db-9371-d8ff5f62f892 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:32.993170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458519f5-6eea-4240-ab78-db8b84eee0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:32.993877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458519f5-6eea-4240-ab78-db8b84eee0ce admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:32.994163 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458519f5-6eea-4240-ab78-db8b84eee0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:32.994443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458519f5-6eea-4240-ab78-db8b84eee0ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:32.995205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458519f5-6eea-4240-ab78-db8b84eee0ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:32.997325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458519f5-6eea-4240-ab78-db8b84eee0ce admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:33.054493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 69/136] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:35:32 2021] POST /identity/v3/projects => generated 302 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:33.641543 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00a96-f6d1-4fbc-a170-b554aa01eb79 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:33.642211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00a96-f6d1-4fbc-a170-b554aa01eb79 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:33.642211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00a96-f6d1-4fbc-a170-b554aa01eb79 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:33.643926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 68/137] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:33.649729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3aa1-74f9-434d-8039-10567cb0e8f2 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:33.650262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3aa1-74f9-434d-8039-10567cb0e8f2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:33.650262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb3aa1-74f9-434d-8039-10567cb0e8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:33.673243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-3fcb3aa1-74f9-434d-8039-10567cb0e8f2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:33.674432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3fcb3aa1-74f9-434d-8039-10567cb0e8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:33.741679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 70/138] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:33.791900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f00a96-f6d1-4fbc-a170-b554aa01eb79 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:33.806371 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f00a96-f6d1-4fbc-a170-b554aa01eb79 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:33.810822 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d592cee-93ec-4917-97d6-5053eeae8139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:33.811629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d592cee-93ec-4917-97d6-5053eeae8139 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:33.811909 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d592cee-93ec-4917-97d6-5053eeae8139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:33.812184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d592cee-93ec-4917-97d6-5053eeae8139 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:33.830207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d592cee-93ec-4917-97d6-5053eeae8139 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:33.837242 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-8d592cee-93ec-4917-97d6-5053eeae8139 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:33.838796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 69/139] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:33.844675 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb3aa1-74f9-434d-8039-10567cb0e8f2 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:33.857657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb3aa1-74f9-434d-8039-10567cb0e8f2 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:33.862216 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2869e0-73f6-4122-9651-e48a180603d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:33.862890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2869e0-73f6-4122-9651-e48a180603d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:33.863174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2869e0-73f6-4122-9651-e48a180603d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:33.863447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2869e0-73f6-4122-9651-e48a180603d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:33.864214 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2869e0-73f6-4122-9651-e48a180603d2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:33.864514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2869e0-73f6-4122-9651-e48a180603d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:33.866149 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2869e0-73f6-4122-9651-e48a180603d2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:33.875433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 71/140] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:33.881072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d592cee-93ec-4917-97d6-5053eeae8139 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:33.896489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d592cee-93ec-4917-97d6-5053eeae8139 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:33.904683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2950b1-66ef-4fbb-8195-a61260ce369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:33.905576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2950b1-66ef-4fbb-8195-a61260ce369f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:33.905854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2950b1-66ef-4fbb-8195-a61260ce369f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:33.906121 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2950b1-66ef-4fbb-8195-a61260ce369f admin admin] PATH_INFO: `/v3/users/413a785e94f448e88ffa0f0569dade74` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:33.913442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2950b1-66ef-4fbb-8195-a61260ce369f admin admin] RBAC: Authorizing `identity:get_user(user_id=413a785e94f448e88ffa0f0569dade74)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:33.916117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2950b1-66ef-4fbb-8195-a61260ce369f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:33.918037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 70/141] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:33 2021] GET /identity/v3/users/413a785e94f448e88ffa0f0569dade74 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:33.923988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2869e0-73f6-4122-9651-e48a180603d2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:33.933896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2869e0-73f6-4122-9651-e48a180603d2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:33.944624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4b3b6-bf3e-4bd5-9ee8-733238270010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:33.945284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4b3b6-bf3e-4bd5-9ee8-733238270010 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:33.945566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4b3b6-bf3e-4bd5-9ee8-733238270010 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:33.945875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4b3b6-bf3e-4bd5-9ee8-733238270010 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:33.958338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4b3b6-bf3e-4bd5-9ee8-733238270010 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:33.960132 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4b3b6-bf3e-4bd5-9ee8-733238270010 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:33.969792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 72/142] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:33.975434 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2950b1-66ef-4fbb-8195-a61260ce369f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:33.985461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2950b1-66ef-4fbb-8195-a61260ce369f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:33.992629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fbd84-d232-47a9-be97-e2638f7ce6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:33.993594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fbd84-d232-47a9-be97-e2638f7ce6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:33.993883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fbd84-d232-47a9-be97-e2638f7ce6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:33.994149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fbd84-d232-47a9-be97-e2638f7ce6c5 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:33.995370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fbd84-d232-47a9-be97-e2638f7ce6c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:33.997457 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fbd84-d232-47a9-be97-e2638f7ce6c5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:33.999126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 71/143] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:33 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:34.005541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4b3b6-bf3e-4bd5-9ee8-733238270010 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:34.015158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4b3b6-bf3e-4bd5-9ee8-733238270010 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:34.024433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3cdc9-a58f-49c0-9cc7-95f7fdf8cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:34.025308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3cdc9-a58f-49c0-9cc7-95f7fdf8cd3a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:34.025590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3cdc9-a58f-49c0-9cc7-95f7fdf8cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:34.025863 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3cdc9-a58f-49c0-9cc7-95f7fdf8cd3a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:34.026714 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3cdc9-a58f-49c0-9cc7-95f7fdf8cd3a admin admin] RBAC: Adding query filter params (role.id=13af8820459545b2b1e4cea1afea8775, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5, user.id=413a785e94f448e88ffa0f0569dade74) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:34.027027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3cdc9-a58f-49c0-9cc7-95f7fdf8cd3a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:34.028928 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3cdc9-a58f-49c0-9cc7-95f7fdf8cd3a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:34.039296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 73/144] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:34 2021] GET /identity/v3/role_assignments?user.id=413a785e94f448e88ffa0f0569dade74&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=13af8820459545b2b1e4cea1afea8775 => generated 608 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:34.858517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80a9b3-6f9b-40bf-972b-76d5abbc6fa2 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:34.859047 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80a9b3-6f9b-40bf-972b-76d5abbc6fa2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:34.859047 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80a9b3-6f9b-40bf-972b-76d5abbc6fa2 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:34.861019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 72/145] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:34.868039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361f99-08e3-44c0-bedf-da806a42365f None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:34.868653 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361f99-08e3-44c0-bedf-da806a42365f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:34.868653 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71361f99-08e3-44c0-bedf-da806a42365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:34.891637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-71361f99-08e3-44c0-bedf-da806a42365f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:34.892958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-71361f99-08e3-44c0-bedf-da806a42365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:34.904255 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 74/146] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:34.946190 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80a9b3-6f9b-40bf-972b-76d5abbc6fa2 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:34.963295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80a9b3-6f9b-40bf-972b-76d5abbc6fa2 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:34.967641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f760dc2-b95b-40be-a633-4c3fb370c6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:34.968456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760dc2-b95b-40be-a633-4c3fb370c6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:34.968776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760dc2-b95b-40be-a633-4c3fb370c6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:34.969048 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f760dc2-b95b-40be-a633-4c3fb370c6f1 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:34.983585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f760dc2-b95b-40be-a633-4c3fb370c6f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:34.990854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-6f760dc2-b95b-40be-a633-4c3fb370c6f1 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:35:34.992076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 73/147] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:35:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:34.998726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361f99-08e3-44c0-bedf-da806a42365f None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.007909 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71361f99-08e3-44c0-bedf-da806a42365f None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.017119 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b768fa2-5b9a-4847-bd6f-d0228cff24b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.017802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b768fa2-5b9a-4847-bd6f-d0228cff24b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.018082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b768fa2-5b9a-4847-bd6f-d0228cff24b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.018355 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b768fa2-5b9a-4847-bd6f-d0228cff24b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.019121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b768fa2-5b9a-4847-bd6f-d0228cff24b4 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:35.019423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b768fa2-5b9a-4847-bd6f-d0228cff24b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.021068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b768fa2-5b9a-4847-bd6f-d0228cff24b4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.030420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 75/148] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:35:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.036722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f760dc2-b95b-40be-a633-4c3fb370c6f1 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.046961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f760dc2-b95b-40be-a633-4c3fb370c6f1 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.053544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e5725-65c5-495c-9751-e90a913d8b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.054430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e5725-65c5-495c-9751-e90a913d8b45 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.054709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e5725-65c5-495c-9751-e90a913d8b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.054981 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e5725-65c5-495c-9751-e90a913d8b45 admin admin] PATH_INFO: `/v3/users/413a785e94f448e88ffa0f0569dade74` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.061352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e5725-65c5-495c-9751-e90a913d8b45 admin admin] RBAC: Authorizing `identity:get_user(user_id=413a785e94f448e88ffa0f0569dade74)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.064258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea51224-b593-4145-bfc7-41db29e90295 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.064543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea51224-b593-4145-bfc7-41db29e90295 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.064847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea51224-b593-4145-bfc7-41db29e90295 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.066611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 76/149] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:35.067555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e5725-65c5-495c-9751-e90a913d8b45 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.069416 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 74/150] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/users/413a785e94f448e88ffa0f0569dade74 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.072677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9203eee-bc3f-4993-a0c2-b3f09fcb3ca6 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.072970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9203eee-bc3f-4993-a0c2-b3f09fcb3ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.073248 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9203eee-bc3f-4993-a0c2-b3f09fcb3ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.077324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e5725-65c5-495c-9751-e90a913d8b45 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.096732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e5725-65c5-495c-9751-e90a913d8b45 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.101857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b9203eee-bc3f-4993-a0c2-b3f09fcb3ca6 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:35.104172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b9203eee-bc3f-4993-a0c2-b3f09fcb3ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:35.109488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b8bb9-da15-436d-8477-3ed24ba55865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.110517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8bb9-da15-436d-8477-3ed24ba55865 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.110997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8bb9-da15-436d-8477-3ed24ba55865 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.112100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b8bb9-da15-436d-8477-3ed24ba55865 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.128609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b8bb9-da15-436d-8477-3ed24ba55865 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.128609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8b8bb9-da15-436d-8477-3ed24ba55865 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.130729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 77/151] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:35.136090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 75/152] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:35.142503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9203eee-bc3f-4993-a0c2-b3f09fcb3ca6 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.152483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9203eee-bc3f-4993-a0c2-b3f09fcb3ca6 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.160150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a983f9-c91f-4952-8685-c45a15a006c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.161204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a983f9-c91f-4952-8685-c45a15a006c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.161630 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a983f9-c91f-4952-8685-c45a15a006c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.162034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a983f9-c91f-4952-8685-c45a15a006c8 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.165819 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b8bb9-da15-436d-8477-3ed24ba55865 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.173910 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a983f9-c91f-4952-8685-c45a15a006c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.176168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b8bb9-da15-436d-8477-3ed24ba55865 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.178426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a983f9-c91f-4952-8685-c45a15a006c8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.183118 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 78/153] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.190561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e541153-44b3-4560-a243-eef7ea2dbfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.191535 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541153-44b3-4560-a243-eef7ea2dbfba admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.191952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541153-44b3-4560-a243-eef7ea2dbfba admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.192357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541153-44b3-4560-a243-eef7ea2dbfba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.194074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a983f9-c91f-4952-8685-c45a15a006c8 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.208819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a983f9-c91f-4952-8685-c45a15a006c8 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.217208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e541153-44b3-4560-a243-eef7ea2dbfba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:35.224650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-2e541153-44b3-4560-a243-eef7ea2dbfba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:35:35.226667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e49e5c-2487-42b6-bc85-57bba7b1fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.227643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e49e5c-2487-42b6-bc85-57bba7b1fed3 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.228063 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e49e5c-2487-42b6-bc85-57bba7b1fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.228466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e49e5c-2487-42b6-bc85-57bba7b1fed3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.229452 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e49e5c-2487-42b6-bc85-57bba7b1fed3 admin admin] RBAC: Adding query filter params (role.id=aa4c4022e45a4188814d7840a56322eb, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5, user.id=413a785e94f448e88ffa0f0569dade74) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:35.229888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e49e5c-2487-42b6-bc85-57bba7b1fed3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.231905 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e49e5c-2487-42b6-bc85-57bba7b1fed3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.236726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 76/154] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:35:35.239880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 79/155] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/role_assignments?user.id=413a785e94f448e88ffa0f0569dade74&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=aa4c4022e45a4188814d7840a56322eb => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:35.246332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e541153-44b3-4560-a243-eef7ea2dbfba admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.256971 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e541153-44b3-4560-a243-eef7ea2dbfba admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.268307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c314b-1c49-4a68-8f5b-896aa747bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.269452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c314b-1c49-4a68-8f5b-896aa747bb39 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.269932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c314b-1c49-4a68-8f5b-896aa747bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.270408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c314b-1c49-4a68-8f5b-896aa747bb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.271438 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c314b-1c49-4a68-8f5b-896aa747bb39 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:35.272021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c314b-1c49-4a68-8f5b-896aa747bb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.274205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c314b-1c49-4a68-8f5b-896aa747bb39 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.291365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 77/156] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.297914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e49e5c-2487-42b6-bc85-57bba7b1fed3 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.315014 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e49e5c-2487-42b6-bc85-57bba7b1fed3 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.330825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731242f-c09e-4f3a-9973-005b20b32845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.334233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731242f-c09e-4f3a-9973-005b20b32845 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.334233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731242f-c09e-4f3a-9973-005b20b32845 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.334233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4731242f-c09e-4f3a-9973-005b20b32845 admin admin] PATH_INFO: `/v3/users/bc88850011704653a832fe050d8d83ab` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.340634 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731242f-c09e-4f3a-9973-005b20b32845 admin admin] RBAC: Authorizing `identity:get_user(user_id=bc88850011704653a832fe050d8d83ab)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.340634 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4731242f-c09e-4f3a-9973-005b20b32845 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.341732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 80/157] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/users/bc88850011704653a832fe050d8d83ab => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.347675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c314b-1c49-4a68-8f5b-896aa747bb39 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.365931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c314b-1c49-4a68-8f5b-896aa747bb39 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.381449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcd0de-1891-496a-abb2-ee8d81be92ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.382125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcd0de-1891-496a-abb2-ee8d81be92ad admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.382405 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcd0de-1891-496a-abb2-ee8d81be92ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.382693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcd0de-1891-496a-abb2-ee8d81be92ad admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.396700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcd0de-1891-496a-abb2-ee8d81be92ad admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.398526 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcd0de-1891-496a-abb2-ee8d81be92ad admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.415124 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 78/158] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:35.421197 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731242f-c09e-4f3a-9973-005b20b32845 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.432611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4731242f-c09e-4f3a-9973-005b20b32845 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.451046 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da580678-cbc6-4962-9944-aa5125aaddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.451925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da580678-cbc6-4962-9944-aa5125aaddc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.452201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da580678-cbc6-4962-9944-aa5125aaddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.452479 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da580678-cbc6-4962-9944-aa5125aaddc5 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.457679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da580678-cbc6-4962-9944-aa5125aaddc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.460013 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da580678-cbc6-4962-9944-aa5125aaddc5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.462761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 81/159] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.470521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcd0de-1891-496a-abb2-ee8d81be92ad admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.482450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcd0de-1891-496a-abb2-ee8d81be92ad admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.487644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c56d4-3382-4468-8c4a-43c8df78c9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.488627 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c56d4-3382-4468-8c4a-43c8df78c9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.489153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c56d4-3382-4468-8c4a-43c8df78c9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.489622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c56d4-3382-4468-8c4a-43c8df78c9d8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.490711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c56d4-3382-4468-8c4a-43c8df78c9d8 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5, user.id=bc88850011704653a832fe050d8d83ab) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:35.491215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c56d4-3382-4468-8c4a-43c8df78c9d8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.493673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c56d4-3382-4468-8c4a-43c8df78c9d8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.502015 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 79/160] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/role_assignments?user.id=bc88850011704653a832fe050d8d83ab&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=f3311ba27a464113b884aa5a1144945d => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.529057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21025-8163-46ee-87e5-afc68e3086c4 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.529400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21025-8163-46ee-87e5-afc68e3086c4 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.529589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d21025-8163-46ee-87e5-afc68e3086c4 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.531370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 82/161] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:35.537672 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bc63b-4d9a-472c-905f-98b36ba5ca2a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.538290 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bc63b-4d9a-472c-905f-98b36ba5ca2a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.538763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459bc63b-4d9a-472c-905f-98b36ba5ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.562158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-459bc63b-4d9a-472c-905f-98b36ba5ca2a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:35.563748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-459bc63b-4d9a-472c-905f-98b36ba5ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:35.576368 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 80/162] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:35.602490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d21025-8163-46ee-87e5-afc68e3086c4 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.619173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d21025-8163-46ee-87e5-afc68e3086c4 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.623576 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b342cfd-7527-4fd5-9d3f-0db6cfbf1f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.624381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b342cfd-7527-4fd5-9d3f-0db6cfbf1f99 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.624743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b342cfd-7527-4fd5-9d3f-0db6cfbf1f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.625013 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b342cfd-7527-4fd5-9d3f-0db6cfbf1f99 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.637825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b342cfd-7527-4fd5-9d3f-0db6cfbf1f99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:35.645507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-6b342cfd-7527-4fd5-9d3f-0db6cfbf1f99 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:35.646793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 83/163] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:35.653352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bc63b-4d9a-472c-905f-98b36ba5ca2a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.666317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459bc63b-4d9a-472c-905f-98b36ba5ca2a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.676511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf76292-7d51-4de4-af42-313feb7a8a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.677589 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76292-7d51-4de4-af42-313feb7a8a4c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.678090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76292-7d51-4de4-af42-313feb7a8a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.678552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf76292-7d51-4de4-af42-313feb7a8a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.679533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf76292-7d51-4de4-af42-313feb7a8a4c admin admin] RBAC: Adding query filter params (name=member) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:35.680031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf76292-7d51-4de4-af42-313feb7a8a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.682020 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf76292-7d51-4de4-af42-313feb7a8a4c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.693136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 81/164] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.699369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b342cfd-7527-4fd5-9d3f-0db6cfbf1f99 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.713212 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b342cfd-7527-4fd5-9d3f-0db6cfbf1f99 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.718605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cee29-8e14-47c6-8af3-026597a255cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.719520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cee29-8e14-47c6-8af3-026597a255cd admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.719843 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cee29-8e14-47c6-8af3-026597a255cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.720109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cee29-8e14-47c6-8af3-026597a255cd admin admin] PATH_INFO: `/v3/users/413a785e94f448e88ffa0f0569dade74` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.721443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cee29-8e14-47c6-8af3-026597a255cd admin admin] RBAC: Authorizing `identity:get_user(user_id=413a785e94f448e88ffa0f0569dade74)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.723785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cee29-8e14-47c6-8af3-026597a255cd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.725802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 84/165] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/users/413a785e94f448e88ffa0f0569dade74 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.732178 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf76292-7d51-4de4-af42-313feb7a8a4c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.742691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf76292-7d51-4de4-af42-313feb7a8a4c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.747575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b452ee-ab07-481f-b859-5120e2b9859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.748470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b452ee-ab07-481f-b859-5120e2b9859a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.748994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b452ee-ab07-481f-b859-5120e2b9859a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.749563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b452ee-ab07-481f-b859-5120e2b9859a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.759696 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b452ee-ab07-481f-b859-5120e2b9859a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.761926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b452ee-ab07-481f-b859-5120e2b9859a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.772144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 82/166] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:35.778077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cee29-8e14-47c6-8af3-026597a255cd admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.789190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cee29-8e14-47c6-8af3-026597a255cd admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.794319 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66728f5f-ffa5-4f5e-80f8-aaf5510aeff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.795176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728f5f-ffa5-4f5e-80f8-aaf5510aeff4 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.795447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728f5f-ffa5-4f5e-80f8-aaf5510aeff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.795716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728f5f-ffa5-4f5e-80f8-aaf5510aeff4 admin admin] PATH_INFO: `/v3/projects/2a6ac833d486473b9e97f0ed5b6fe38f` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.796945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66728f5f-ffa5-4f5e-80f8-aaf5510aeff4 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a6ac833d486473b9e97f0ed5b6fe38f)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.799003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66728f5f-ffa5-4f5e-80f8-aaf5510aeff4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.801000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 85/167] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/projects/2a6ac833d486473b9e97f0ed5b6fe38f => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.806149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f017d-59e2-4ad1-9157-d3087972d405 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.806385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f017d-59e2-4ad1-9157-d3087972d405 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.806870 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f017d-59e2-4ad1-9157-d3087972d405 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.807795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66728f5f-ffa5-4f5e-80f8-aaf5510aeff4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.808663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 83/168] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:35:35.817662 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfe903-c66b-46f2-95fb-c0b3abe91216 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.817938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfe903-c66b-46f2-95fb-c0b3abe91216 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.818210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfe903-c66b-46f2-95fb-c0b3abe91216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.819557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66728f5f-ffa5-4f5e-80f8-aaf5510aeff4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.824855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c163a-273c-44c7-b796-e8acc8ca9642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.825514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c163a-273c-44c7-b796-e8acc8ca9642 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.825793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c163a-273c-44c7-b796-e8acc8ca9642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.826066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c163a-273c-44c7-b796-e8acc8ca9642 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.826906 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c163a-273c-44c7-b796-e8acc8ca9642 admin admin] RBAC: Adding query filter params (role.id=13af8820459545b2b1e4cea1afea8775, scope.project.id=2a6ac833d486473b9e97f0ed5b6fe38f, user.id=413a785e94f448e88ffa0f0569dade74) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:35.827215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c163a-273c-44c7-b796-e8acc8ca9642 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.829107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c163a-273c-44c7-b796-e8acc8ca9642 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.836979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 86/169] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/role_assignments?user.id=413a785e94f448e88ffa0f0569dade74&scope.project.id=2a6ac833d486473b9e97f0ed5b6fe38f&role.id=13af8820459545b2b1e4cea1afea8775 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:35.844313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-9fdfe903-c66b-46f2-95fb-c0b3abe91216 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:35.845657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9fdfe903-c66b-46f2-95fb-c0b3abe91216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:35.855374 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 84/170] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:35.878393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c163a-273c-44c7-b796-e8acc8ca9642 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.889522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c163a-273c-44c7-b796-e8acc8ca9642 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.894788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b42998-c0ef-433f-ae28-980d54c2d56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.895665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b42998-c0ef-433f-ae28-980d54c2d56c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.896005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b42998-c0ef-433f-ae28-980d54c2d56c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.896337 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b42998-c0ef-433f-ae28-980d54c2d56c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.911613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b42998-c0ef-433f-ae28-980d54c2d56c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:35.919613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-e8b42998-c0ef-433f-ae28-980d54c2d56c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 13 16:35:35.921224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 87/171] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:35.927507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfe903-c66b-46f2-95fb-c0b3abe91216 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.937981 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfe903-c66b-46f2-95fb-c0b3abe91216 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.943108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ba331-3288-48c4-9294-5fe17b2d4723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.943803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ba331-3288-48c4-9294-5fe17b2d4723 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.944077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ba331-3288-48c4-9294-5fe17b2d4723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.944320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ba331-3288-48c4-9294-5fe17b2d4723 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.945160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ba331-3288-48c4-9294-5fe17b2d4723 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:35.945459 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ba331-3288-48c4-9294-5fe17b2d4723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.947706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ba331-3288-48c4-9294-5fe17b2d4723 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.957430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 85/172] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.964247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b42998-c0ef-433f-ae28-980d54c2d56c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:35.974895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b42998-c0ef-433f-ae28-980d54c2d56c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:35.980262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa9bdc-a7a7-4c40-bef0-70ea51ce178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:35.981235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9bdc-a7a7-4c40-bef0-70ea51ce178d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:35.981520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9bdc-a7a7-4c40-bef0-70ea51ce178d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:35.981829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa9bdc-a7a7-4c40-bef0-70ea51ce178d admin admin] PATH_INFO: `/v3/users/1ad52b11880742c48abf5eed9474fd41` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:35.983146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa9bdc-a7a7-4c40-bef0-70ea51ce178d admin admin] RBAC: Authorizing `identity:get_user(user_id=1ad52b11880742c48abf5eed9474fd41)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:35.985413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa9bdc-a7a7-4c40-bef0-70ea51ce178d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:35.987355 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 88/173] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/users/1ad52b11880742c48abf5eed9474fd41 => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:35.994281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ba331-3288-48c4-9294-5fe17b2d4723 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:36.004776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ba331-3288-48c4-9294-5fe17b2d4723 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:36.009796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2334b6-a78c-4446-b8d2-216cb5a59442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:36.010704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2334b6-a78c-4446-b8d2-216cb5a59442 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:36.010983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2334b6-a78c-4446-b8d2-216cb5a59442 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:36.011255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2334b6-a78c-4446-b8d2-216cb5a59442 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:36.012709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2334b6-a78c-4446-b8d2-216cb5a59442 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:36.014852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2334b6-a78c-4446-b8d2-216cb5a59442 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:36.017339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 86/174] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:35 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:36.024023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa9bdc-a7a7-4c40-bef0-70ea51ce178d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:36.034770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa9bdc-a7a7-4c40-bef0-70ea51ce178d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:36.039896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f608c-0768-4d7d-9f96-d25e62ca562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:36.040892 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f608c-0768-4d7d-9f96-d25e62ca562d admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:36.041347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f608c-0768-4d7d-9f96-d25e62ca562d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:36.041696 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f608c-0768-4d7d-9f96-d25e62ca562d admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/users/1ad52b11880742c48abf5eed9474fd41/roles/59ca0f318c444b35add02b8d1f75c421` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:36.043887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f608c-0768-4d7d-9f96-d25e62ca562d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c905a70f0f4dc58022cf7d31f2b3c5, user_id=1ad52b11880742c48abf5eed9474fd41, role_id=59ca0f318c444b35add02b8d1f75c421)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:36.046739 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f608c-0768-4d7d-9f96-d25e62ca562d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:36.063777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 89/175] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:35:36 2021] PUT /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/users/1ad52b11880742c48abf5eed9474fd41/roles/59ca0f318c444b35add02b8d1f75c421 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:35:36.412615 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff4a83-68b3-40d7-96bd-a0365eaadcb7 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:36.412883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff4a83-68b3-40d7-96bd-a0365eaadcb7 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:36.413179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff4a83-68b3-40d7-96bd-a0365eaadcb7 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:36.415268 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 87/176] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:36.421090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23fa18-77c4-4fe9-afc0-c1f87c6f488d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:36.421376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23fa18-77c4-4fe9-afc0-c1f87c6f488d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:36.421647 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23fa18-77c4-4fe9-afc0-c1f87c6f488d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:36.439518 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-2b23fa18-77c4-4fe9-afc0-c1f87c6f488d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:36.440709 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-2b23fa18-77c4-4fe9-afc0-c1f87c6f488d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:36.499555 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 90/177] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:36 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:36.528446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff4a83-68b3-40d7-96bd-a0365eaadcb7 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:36.541516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff4a83-68b3-40d7-96bd-a0365eaadcb7 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:36.546877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256d50f6-fbb5-4510-97c2-6828f4f25d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:36.547665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d50f6-fbb5-4510-97c2-6828f4f25d6f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:36.547945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d50f6-fbb5-4510-97c2-6828f4f25d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:36.548214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256d50f6-fbb5-4510-97c2-6828f4f25d6f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:36.549559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d50f6-fbb5-4510-97c2-6828f4f25d6f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:36.551300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256d50f6-fbb5-4510-97c2-6828f4f25d6f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:36.553073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 88/178] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:36 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:36.558807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23fa18-77c4-4fe9-afc0-c1f87c6f488d None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:36.567861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23fa18-77c4-4fe9-afc0-c1f87c6f488d None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:36.572988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02feb1-bc0d-48a8-aea2-a2f84359aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:36.573581 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02feb1-bc0d-48a8-aea2-a2f84359aa6e admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:36.573861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02feb1-bc0d-48a8-aea2-a2f84359aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:36.574136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02feb1-bc0d-48a8-aea2-a2f84359aa6e admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:36.574865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02feb1-bc0d-48a8-aea2-a2f84359aa6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:36.576800 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02feb1-bc0d-48a8-aea2-a2f84359aa6e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:36.598087 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 91/179] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:35:36 2021] POST /identity/v3/users => generated 283 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:38.417392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436df66-0a0c-4b3f-907a-91194307f4cc None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:38.417908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436df66-0a0c-4b3f-907a-91194307f4cc None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:38.417908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436df66-0a0c-4b3f-907a-91194307f4cc None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:38.419842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 89/180] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:38.425919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2530d-eeb3-4342-a295-02c8bbcf7643 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:38.426366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2530d-eeb3-4342-a295-02c8bbcf7643 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:38.426538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2530d-eeb3-4342-a295-02c8bbcf7643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:38.444660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-19c2530d-eeb3-4342-a295-02c8bbcf7643 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:38.445892 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-19c2530d-eeb3-4342-a295-02c8bbcf7643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:38.453972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 92/181] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:38.478169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436df66-0a0c-4b3f-907a-91194307f4cc None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:38.490514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436df66-0a0c-4b3f-907a-91194307f4cc None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:38.495228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbd518-fc17-40a9-b121-22ff91e3f8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:38.496239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbd518-fc17-40a9-b121-22ff91e3f8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:38.496762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbd518-fc17-40a9-b121-22ff91e3f8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:38.497217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbd518-fc17-40a9-b121-22ff91e3f8d2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:38.507652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbd518-fc17-40a9-b121-22ff91e3f8d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:38.514648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-cbbbd518-fc17-40a9-b121-22ff91e3f8d2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 13 16:35:38.516706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 90/182] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:38 2021] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:38.523225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2530d-eeb3-4342-a295-02c8bbcf7643 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:38.532650 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2530d-eeb3-4342-a295-02c8bbcf7643 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:38.537179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bc79a-951e-426f-a9da-5451b0e9025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:38.538055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bc79a-951e-426f-a9da-5451b0e9025b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:38.538518 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bc79a-951e-426f-a9da-5451b0e9025b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:38.538991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8bc79a-951e-426f-a9da-5451b0e9025b admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:38.540258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bc79a-951e-426f-a9da-5451b0e9025b admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:38.540775 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bc79a-951e-426f-a9da-5451b0e9025b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:38.542597 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8bc79a-951e-426f-a9da-5451b0e9025b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:38.556594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 93/183] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:38 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:38.557943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbd518-fc17-40a9-b121-22ff91e3f8d2 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:38.568385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbd518-fc17-40a9-b121-22ff91e3f8d2 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:38.573112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c2d15-d606-49ed-b345-9848de2259e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:38.574199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2d15-d606-49ed-b345-9848de2259e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:38.574664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2d15-d606-49ed-b345-9848de2259e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:38.575136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c2d15-d606-49ed-b345-9848de2259e3 admin admin] PATH_INFO: `/v3/users/1ad52b11880742c48abf5eed9474fd41` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:38.576517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c2d15-d606-49ed-b345-9848de2259e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ad52b11880742c48abf5eed9474fd41)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:38.578923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c2d15-d606-49ed-b345-9848de2259e3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:38.580838 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 91/184] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:38 2021] GET /identity/v3/users/1ad52b11880742c48abf5eed9474fd41 => generated 289 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:38.588708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bc79a-951e-426f-a9da-5451b0e9025b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:38.598235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8bc79a-951e-426f-a9da-5451b0e9025b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:38.602826 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17197550-44fc-44d5-ab5e-e6f21700a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:38.603626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17197550-44fc-44d5-ab5e-e6f21700a87e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:38.604044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17197550-44fc-44d5-ab5e-e6f21700a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:38.604454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17197550-44fc-44d5-ab5e-e6f21700a87e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:38.612846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17197550-44fc-44d5-ab5e-e6f21700a87e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:38.614765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17197550-44fc-44d5-ab5e-e6f21700a87e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:38.628772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 94/185] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:38.631315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c2d15-d606-49ed-b345-9848de2259e3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:38.642218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c2d15-d606-49ed-b345-9848de2259e3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:38.647221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93183090-2d6b-492b-8c66-eb5f5236fd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:38.648344 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93183090-2d6b-492b-8c66-eb5f5236fd35 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:38.648889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93183090-2d6b-492b-8c66-eb5f5236fd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:38.649307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93183090-2d6b-492b-8c66-eb5f5236fd35 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:38.650844 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93183090-2d6b-492b-8c66-eb5f5236fd35 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:38.653230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93183090-2d6b-492b-8c66-eb5f5236fd35 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:38.655188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 92/186] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:38 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:38.661963 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17197550-44fc-44d5-ab5e-e6f21700a87e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:38.671539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17197550-44fc-44d5-ab5e-e6f21700a87e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:38.676120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d6303-bcfd-47d4-ade0-512f2c5df11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:38.677061 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6303-bcfd-47d4-ade0-512f2c5df11f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:38.677480 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6303-bcfd-47d4-ade0-512f2c5df11f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:38.677888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d6303-bcfd-47d4-ade0-512f2c5df11f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:38.678873 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6303-bcfd-47d4-ade0-512f2c5df11f admin admin] RBAC: Adding query filter params (role.id=59ca0f318c444b35add02b8d1f75c421, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5, user.id=1ad52b11880742c48abf5eed9474fd41) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:38.679344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6303-bcfd-47d4-ade0-512f2c5df11f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:38.681732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d6303-bcfd-47d4-ade0-512f2c5df11f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:38.688520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 95/187] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:38 2021] GET /identity/v3/role_assignments?user.id=1ad52b11880742c48abf5eed9474fd41&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=59ca0f318c444b35add02b8d1f75c421 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:39.045482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f614-8289-4052-abbf-c22beafeb341 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.045849 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f614-8289-4052-abbf-c22beafeb341 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.046042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f614-8289-4052-abbf-c22beafeb341 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.047883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 93/188] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:39.053597 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c6087-b60b-4527-983e-a95e7bf20d74 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.053863 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c6087-b60b-4527-983e-a95e7bf20d74 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.054164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c6087-b60b-4527-983e-a95e7bf20d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.072414 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b42c6087-b60b-4527-983e-a95e7bf20d74 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:39.073646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b42c6087-b60b-4527-983e-a95e7bf20d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:39.081640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 96/189] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:39.106151 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1f614-8289-4052-abbf-c22beafeb341 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.118961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1f614-8289-4052-abbf-c22beafeb341 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.123536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a8823-1a48-48fa-86a2-8655e1b0c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.124330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a8823-1a48-48fa-86a2-8655e1b0c488 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.124623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a8823-1a48-48fa-86a2-8655e1b0c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.124914 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a8823-1a48-48fa-86a2-8655e1b0c488 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.135510 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7a8823-1a48-48fa-86a2-8655e1b0c488 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:39.142654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-8d7a8823-1a48-48fa-86a2-8655e1b0c488 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:35:39.143846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 94/190] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:39.150552 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c6087-b60b-4527-983e-a95e7bf20d74 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.160234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c6087-b60b-4527-983e-a95e7bf20d74 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.165012 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1acc5-73d0-4273-a121-2a602db59369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.165779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1acc5-73d0-4273-a121-2a602db59369 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.166129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1acc5-73d0-4273-a121-2a602db59369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.166471 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1acc5-73d0-4273-a121-2a602db59369 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.167305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1acc5-73d0-4273-a121-2a602db59369 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:39.167690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1acc5-73d0-4273-a121-2a602db59369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.169424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1acc5-73d0-4273-a121-2a602db59369 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.178470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 97/191] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:39.184999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a8823-1a48-48fa-86a2-8655e1b0c488 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.192158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f21da-cc79-4454-9169-c6eebb16a636 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.192449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f21da-cc79-4454-9169-c6eebb16a636 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.192727 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f21da-cc79-4454-9169-c6eebb16a636 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.194618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 98/192] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:35:39.195272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a8823-1a48-48fa-86a2-8655e1b0c488 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.200042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b815999-094b-493a-b522-e6d26f17ae91 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.200294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8ffe8-bf00-4080-8251-e689984bd214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.200407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b815999-094b-493a-b522-e6d26f17ae91 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.200588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b815999-094b-493a-b522-e6d26f17ae91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.201204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ffe8-bf00-4080-8251-e689984bd214 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.201481 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ffe8-bf00-4080-8251-e689984bd214 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.201739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8ffe8-bf00-4080-8251-e689984bd214 admin admin] PATH_INFO: `/v3/users/11b7f205875c4a47b8f6840f14d097e6` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.215773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8ffe8-bf00-4080-8251-e689984bd214 admin admin] RBAC: Authorizing `identity:get_user(user_id=11b7f205875c4a47b8f6840f14d097e6)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.217944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7b815999-094b-493a-b522-e6d26f17ae91 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:39.218068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8ffe8-bf00-4080-8251-e689984bd214 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.219144 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7b815999-094b-493a-b522-e6d26f17ae91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:39.219642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 95/193] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/users/11b7f205875c4a47b8f6840f14d097e6 => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:39.221975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df534a6-2338-435c-9fe8-2e4e344e7f57 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.222277 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df534a6-2338-435c-9fe8-2e4e344e7f57 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.222539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df534a6-2338-435c-9fe8-2e4e344e7f57 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.224300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 96/194] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:39.225564 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df534a6-2338-435c-9fe8-2e4e344e7f57 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.228109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 99/195] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:39.233724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa282a-30c3-4815-8481-3119d79636c8 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.233996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa282a-30c3-4815-8481-3119d79636c8 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.234273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa282a-30c3-4815-8481-3119d79636c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.237948 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df534a6-2338-435c-9fe8-2e4e344e7f57 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.242419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b378586-7473-49e1-a7b2-4b66c5188d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.243373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378586-7473-49e1-a7b2-4b66c5188d22 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.243857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378586-7473-49e1-a7b2-4b66c5188d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.244311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b378586-7473-49e1-a7b2-4b66c5188d22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.251704 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-34aa282a-30c3-4815-8481-3119d79636c8 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:39.252899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b378586-7473-49e1-a7b2-4b66c5188d22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.253057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-34aa282a-30c3-4815-8481-3119d79636c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:39.254643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b378586-7473-49e1-a7b2-4b66c5188d22 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.260382 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 100/196] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:39.261256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa282a-30c3-4815-8481-3119d79636c8 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.263604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 97/197] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 13 16:35:39.269622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b378586-7473-49e1-a7b2-4b66c5188d22 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.270777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa282a-30c3-4815-8481-3119d79636c8 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.275279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034a2d6-b27a-4581-b139-e066b9e6608d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.276066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034a2d6-b27a-4581-b139-e066b9e6608d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.276346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034a2d6-b27a-4581-b139-e066b9e6608d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.276647 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034a2d6-b27a-4581-b139-e066b9e6608d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.277869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b378586-7473-49e1-a7b2-4b66c5188d22 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.282250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320009ef-4a52-40d0-8140-16b597e41e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.283077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320009ef-4a52-40d0-8140-16b597e41e1c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.283357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320009ef-4a52-40d0-8140-16b597e41e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.283652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320009ef-4a52-40d0-8140-16b597e41e1c admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.284835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320009ef-4a52-40d0-8140-16b597e41e1c admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.286880 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320009ef-4a52-40d0-8140-16b597e41e1c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.287040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3034a2d6-b27a-4581-b139-e066b9e6608d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:39.288524 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 98/198] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:39.290279 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320009ef-4a52-40d0-8140-16b597e41e1c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.294618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-3034a2d6-b27a-4581-b139-e066b9e6608d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:35:39.300177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 101/199] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:39.300177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034a2d6-b27a-4581-b139-e066b9e6608d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.300337 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320009ef-4a52-40d0-8140-16b597e41e1c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.303619 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc559be-6453-4929-9df9-e0347d5b4775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.304355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc559be-6453-4929-9df9-e0347d5b4775 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.304655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc559be-6453-4929-9df9-e0347d5b4775 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.304923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc559be-6453-4929-9df9-e0347d5b4775 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.306000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034a2d6-b27a-4581-b139-e066b9e6608d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.306146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc559be-6453-4929-9df9-e0347d5b4775 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.307792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc559be-6453-4929-9df9-e0347d5b4775 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.309376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 99/200] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:39.310264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38824a-a890-4110-aec5-3220ef149fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.310933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38824a-a890-4110-aec5-3220ef149fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.311219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38824a-a890-4110-aec5-3220ef149fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.311496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38824a-a890-4110-aec5-3220ef149fb6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.312331 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38824a-a890-4110-aec5-3220ef149fb6 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=d1488ecfa5b54f44826bde312726eb2b, user.id=11b7f205875c4a47b8f6840f14d097e6) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:39.312710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38824a-a890-4110-aec5-3220ef149fb6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.313427 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc559be-6453-4929-9df9-e0347d5b4775 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.314884 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38824a-a890-4110-aec5-3220ef149fb6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.321253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 102/201] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/role_assignments?user.id=11b7f205875c4a47b8f6840f14d097e6&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=f3311ba27a464113b884aa5a1144945d => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:39.322072 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38824a-a890-4110-aec5-3220ef149fb6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.323303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc559be-6453-4929-9df9-e0347d5b4775 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.327809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20264109-e09a-4f56-a989-69ae62eac448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.328604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20264109-e09a-4f56-a989-69ae62eac448 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.328894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20264109-e09a-4f56-a989-69ae62eac448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.329164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20264109-e09a-4f56-a989-69ae62eac448 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.329970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20264109-e09a-4f56-a989-69ae62eac448 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:39.330270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20264109-e09a-4f56-a989-69ae62eac448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.334017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20264109-e09a-4f56-a989-69ae62eac448 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.340920 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38824a-a890-4110-aec5-3220ef149fb6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.342898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 100/202] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:39.346214 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107285cc-4636-42f5-8680-777987239988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.346956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107285cc-4636-42f5-8680-777987239988 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.347231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107285cc-4636-42f5-8680-777987239988 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.347532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107285cc-4636-42f5-8680-777987239988 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.349228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20264109-e09a-4f56-a989-69ae62eac448 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.349791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107285cc-4636-42f5-8680-777987239988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.351791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107285cc-4636-42f5-8680-777987239988 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.362524 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20264109-e09a-4f56-a989-69ae62eac448 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.367907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089968d-67be-4a50-8be1-8026156e1238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.368861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089968d-67be-4a50-8be1-8026156e1238 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.369156 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089968d-67be-4a50-8be1-8026156e1238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.369388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089968d-67be-4a50-8be1-8026156e1238 admin admin] PATH_INFO: `/v3/users/11b7f205875c4a47b8f6840f14d097e6` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.370703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089968d-67be-4a50-8be1-8026156e1238 admin admin] RBAC: Authorizing `identity:get_user(user_id=11b7f205875c4a47b8f6840f14d097e6)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.372908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089968d-67be-4a50-8be1-8026156e1238 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.374745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 101/203] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/users/11b7f205875c4a47b8f6840f14d097e6 => generated 283 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:39.375682 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 103/204] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:35:39 2021] POST /identity/v3/users => generated 297 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:39.382112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089968d-67be-4a50-8be1-8026156e1238 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.399892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089968d-67be-4a50-8be1-8026156e1238 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.404550 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c324-efe3-4819-921b-fa36bdcd9600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.405298 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c324-efe3-4819-921b-fa36bdcd9600 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.405586 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c324-efe3-4819-921b-fa36bdcd9600 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.405863 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c324-efe3-4819-921b-fa36bdcd9600 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.415250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6c324-efe3-4819-921b-fa36bdcd9600 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.417149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6c324-efe3-4819-921b-fa36bdcd9600 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.427372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 102/205] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 13 16:35:39.433817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107285cc-4636-42f5-8680-777987239988 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.444647 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107285cc-4636-42f5-8680-777987239988 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.449685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32021300-d8b0-4959-a23d-64451dfa859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.450588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32021300-d8b0-4959-a23d-64451dfa859e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.450859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32021300-d8b0-4959-a23d-64451dfa859e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.451138 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32021300-d8b0-4959-a23d-64451dfa859e admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.452860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32021300-d8b0-4959-a23d-64451dfa859e admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.454945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32021300-d8b0-4959-a23d-64451dfa859e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.457021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 104/206] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:39.464058 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c324-efe3-4819-921b-fa36bdcd9600 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:39.473971 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c324-efe3-4819-921b-fa36bdcd9600 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:39.478787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26483f79-560a-4f6b-b626-4b5ec23ab18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:39.479474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26483f79-560a-4f6b-b626-4b5ec23ab18e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:39.479761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26483f79-560a-4f6b-b626-4b5ec23ab18e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:39.480039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26483f79-560a-4f6b-b626-4b5ec23ab18e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:39.480951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26483f79-560a-4f6b-b626-4b5ec23ab18e admin admin] RBAC: Adding query filter params (role.id=aa4c4022e45a4188814d7840a56322eb, scope.project.id=d1488ecfa5b54f44826bde312726eb2b, user.id=11b7f205875c4a47b8f6840f14d097e6) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:39.481277 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26483f79-560a-4f6b-b626-4b5ec23ab18e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:39.483197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26483f79-560a-4f6b-b626-4b5ec23ab18e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:39.489902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 103/207] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:39 2021] GET /identity/v3/role_assignments?user.id=11b7f205875c4a47b8f6840f14d097e6&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=aa4c4022e45a4188814d7840a56322eb => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:41.729303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0152e04-7925-4d29-adea-0b822e2daa38 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:41.729836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0152e04-7925-4d29-adea-0b822e2daa38 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:41.729836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0152e04-7925-4d29-adea-0b822e2daa38 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:41.731641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 105/208] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:41.737917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8933-4512-4d8f-aa3c-3d6246d2fb0f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:41.738362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8933-4512-4d8f-aa3c-3d6246d2fb0f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:41.738505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a8933-4512-4d8f-aa3c-3d6246d2fb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:41.756734 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-4c1a8933-4512-4d8f-aa3c-3d6246d2fb0f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:41.757991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-4c1a8933-4512-4d8f-aa3c-3d6246d2fb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:41.765655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 104/209] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:41.788933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0152e04-7925-4d29-adea-0b822e2daa38 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:41.801472 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0152e04-7925-4d29-adea-0b822e2daa38 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:41.806014 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d62ac8-3f75-41de-89bb-6e4bb3306264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:41.806816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d62ac8-3f75-41de-89bb-6e4bb3306264 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:41.807097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d62ac8-3f75-41de-89bb-6e4bb3306264 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:41.807369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d62ac8-3f75-41de-89bb-6e4bb3306264 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:41.817999 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d62ac8-3f75-41de-89bb-6e4bb3306264 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:41.825220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-29d62ac8-3f75-41de-89bb-6e4bb3306264 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:35:41.826622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 106/210] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:35:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:41.832856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a8933-4512-4d8f-aa3c-3d6246d2fb0f None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:41.841945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a8933-4512-4d8f-aa3c-3d6246d2fb0f None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:41.846342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aec29c-6e80-4c23-89f8-d75a6655f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:41.847011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aec29c-6e80-4c23-89f8-d75a6655f0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:41.847295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aec29c-6e80-4c23-89f8-d75a6655f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:41.847563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aec29c-6e80-4c23-89f8-d75a6655f0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:41.848345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aec29c-6e80-4c23-89f8-d75a6655f0e5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:41.848671 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aec29c-6e80-4c23-89f8-d75a6655f0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:41.850459 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aec29c-6e80-4c23-89f8-d75a6655f0e5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:41.859642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 105/211] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:41.863066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f31c07-ccb6-4f4c-8182-eebb59bf663c None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:41.863350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f31c07-ccb6-4f4c-8182-eebb59bf663c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:41.863624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f31c07-ccb6-4f4c-8182-eebb59bf663c None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:41.865531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aec29c-6e80-4c23-89f8-d75a6655f0e5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:41.865887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 107/212] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:41.871450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c1b1e-f205-4e1e-9f99-ae9aa45ed795 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:41.871729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c1b1e-f205-4e1e-9f99-ae9aa45ed795 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:41.872004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c1b1e-f205-4e1e-9f99-ae9aa45ed795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:41.876113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aec29c-6e80-4c23-89f8-d75a6655f0e5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:41.880533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28ca64-59f9-4d45-b27f-e91009c92ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:41.881427 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28ca64-59f9-4d45-b27f-e91009c92ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:41.881703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28ca64-59f9-4d45-b27f-e91009c92ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:41.881970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28ca64-59f9-4d45-b27f-e91009c92ee4 admin admin] PATH_INFO: `/v3/users/11b7f205875c4a47b8f6840f14d097e6` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:41.883281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28ca64-59f9-4d45-b27f-e91009c92ee4 admin admin] RBAC: Authorizing `identity:get_user(user_id=11b7f205875c4a47b8f6840f14d097e6)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:41.885475 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b28ca64-59f9-4d45-b27f-e91009c92ee4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:41.887088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 106/213] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:41 2021] GET /identity/v3/users/11b7f205875c4a47b8f6840f14d097e6 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:41.890502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-ec8c1b1e-f205-4e1e-9f99-ae9aa45ed795 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:41.892036 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ec8c1b1e-f205-4e1e-9f99-ae9aa45ed795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:41.893358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28ca64-59f9-4d45-b27f-e91009c92ee4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:41.900310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 108/214] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:41.901625 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c15be-60d5-4f0a-8d38-c76ab3325761 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:41.901904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c15be-60d5-4f0a-8d38-c76ab3325761 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:41.902173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c15be-60d5-4f0a-8d38-c76ab3325761 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:41.903373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28ca64-59f9-4d45-b27f-e91009c92ee4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:41.907590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c821e8-8c51-4acd-b6b1-a3770570501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:41.908432 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c821e8-8c51-4acd-b6b1-a3770570501d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:41.908741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c821e8-8c51-4acd-b6b1-a3770570501d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:41.909010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c821e8-8c51-4acd-b6b1-a3770570501d admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:41.910186 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c821e8-8c51-4acd-b6b1-a3770570501d admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:41.912230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c821e8-8c51-4acd-b6b1-a3770570501d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:41.912711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 109/215] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:41 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:41.913967 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 107/216] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:41 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:41.920472 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7cafd-2973-4e2e-8b58-79388e30dc42 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:41.920797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7cafd-2973-4e2e-8b58-79388e30dc42 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:41.921077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7cafd-2973-4e2e-8b58-79388e30dc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:41.923467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c821e8-8c51-4acd-b6b1-a3770570501d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:41.934026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c821e8-8c51-4acd-b6b1-a3770570501d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:41.939032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a50b7-c603-4d5b-a85e-dc578972c525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:41.939925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a50b7-c603-4d5b-a85e-dc578972c525 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:41.940205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a50b7-c603-4d5b-a85e-dc578972c525 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:41.940476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a50b7-c603-4d5b-a85e-dc578972c525 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b/users/11b7f205875c4a47b8f6840f14d097e6/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:41.942445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a50b7-c603-4d5b-a85e-dc578972c525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1488ecfa5b54f44826bde312726eb2b, user_id=11b7f205875c4a47b8f6840f14d097e6, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:41.945119 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a50b7-c603-4d5b-a85e-dc578972c525 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:41.954139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a0a7cafd-2973-4e2e-8b58-79388e30dc42 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:41.955322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a0a7cafd-2973-4e2e-8b58-79388e30dc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:41.959252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 108/217] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:35:41 2021] PUT /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b/users/11b7f205875c4a47b8f6840f14d097e6/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:35:41.965749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a50b7-c603-4d5b-a85e-dc578972c525 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.028672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 110/218] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:42.028672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479763e-9b0a-4661-bfb3-73a196356784 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.028672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479763e-9b0a-4661-bfb3-73a196356784 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.028672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479763e-9b0a-4661-bfb3-73a196356784 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.028672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 111/219] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:42.031604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bee4-1e15-4cfb-a0e9-c7921da0749f None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.031894 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bee4-1e15-4cfb-a0e9-c7921da0749f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.032169 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bee4-1e15-4cfb-a0e9-c7921da0749f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.038813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a50b7-c603-4d5b-a85e-dc578972c525 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.043544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d20d17-fbaa-4601-a6ef-dc0905a32407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.046026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d20d17-fbaa-4601-a6ef-dc0905a32407 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.046431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d20d17-fbaa-4601-a6ef-dc0905a32407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.046610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d20d17-fbaa-4601-a6ef-dc0905a32407 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.053624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-ef84bee4-1e15-4cfb-a0e9-c7921da0749f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:42.054878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ef84bee4-1e15-4cfb-a0e9-c7921da0749f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:42.058534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d20d17-fbaa-4601-a6ef-dc0905a32407 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:42.065681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-f4d20d17-fbaa-4601-a6ef-dc0905a32407 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:42.067184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 109/220] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:41 2021] GET /identity/v3/roles/member => generated 84 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:42.068892 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 112/221] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:42.070179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84bee4-1e15-4cfb-a0e9-c7921da0749f None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.073305 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d20d17-fbaa-4601-a6ef-dc0905a32407 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.081901 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84bee4-1e15-4cfb-a0e9-c7921da0749f None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.083508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d20d17-fbaa-4601-a6ef-dc0905a32407 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.088061 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5c10f-1989-4f5f-a54e-491e45f8efa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.088243 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cc5e2-6f11-4c3b-bdfc-986caa539edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.088920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc5e2-6f11-4c3b-bdfc-986caa539edb admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.089200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc5e2-6f11-4c3b-bdfc-986caa539edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.089476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cc5e2-6f11-4c3b-bdfc-986caa539edb admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.090004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c10f-1989-4f5f-a54e-491e45f8efa5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.090578 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c10f-1989-4f5f-a54e-491e45f8efa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.090727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cc5e2-6f11-4c3b-bdfc-986caa539edb admin admin] RBAC: Adding query filter params (name=member) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:42.090903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5c10f-1989-4f5f-a54e-491e45f8efa5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.091004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cc5e2-6f11-4c3b-bdfc-986caa539edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:42.092533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cc5e2-6f11-4c3b-bdfc-986caa539edb admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:42.102836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 110/222] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:42 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:42.103035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cc5e2-6f11-4c3b-bdfc-986caa539edb admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.105688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5c10f-1989-4f5f-a54e-491e45f8efa5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:42.113325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cc5e2-6f11-4c3b-bdfc-986caa539edb admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.115383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-45b5c10f-1989-4f5f-a54e-491e45f8efa5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:35:42.116681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 113/223] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:35:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:42.117491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5c10f-1989-4f5f-a54e-491e45f8efa5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.120828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61cab1-a478-4bf9-b8fd-a5e92521a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.122108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61cab1-a478-4bf9-b8fd-a5e92521a2dc admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.122602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61cab1-a478-4bf9-b8fd-a5e92521a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.122879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61cab1-a478-4bf9-b8fd-a5e92521a2dc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.124111 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61cab1-a478-4bf9-b8fd-a5e92521a2dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:42.125874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61cab1-a478-4bf9-b8fd-a5e92521a2dc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:42.127676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 111/224] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:42 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:42.128383 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61cab1-a478-4bf9-b8fd-a5e92521a2dc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.133283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5c10f-1989-4f5f-a54e-491e45f8efa5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.137907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca45295-2b46-4e75-8675-86e9efea30aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.138842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45295-2b46-4e75-8675-86e9efea30aa admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.139070 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45295-2b46-4e75-8675-86e9efea30aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.139355 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca45295-2b46-4e75-8675-86e9efea30aa admin admin] PATH_INFO: `/v3/users/25f6621aea124bc6966d554a6f0755a3` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.143556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61cab1-a478-4bf9-b8fd-a5e92521a2dc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.147265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a86efe-22de-4470-8515-6ad6db619249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.147943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a86efe-22de-4470-8515-6ad6db619249 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.148226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a86efe-22de-4470-8515-6ad6db619249 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.148972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a86efe-22de-4470-8515-6ad6db619249 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.149813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a86efe-22de-4470-8515-6ad6db619249 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:42.149813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a86efe-22de-4470-8515-6ad6db619249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:42.151446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a86efe-22de-4470-8515-6ad6db619249 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:42.157116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca45295-2b46-4e75-8675-86e9efea30aa admin admin] RBAC: Authorizing `identity:get_user(user_id=25f6621aea124bc6966d554a6f0755a3)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:42.159282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca45295-2b46-4e75-8675-86e9efea30aa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:42.160475 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 112/225] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:35:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:42.161563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a86efe-22de-4470-8515-6ad6db619249 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.166733 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 114/226] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:42 2021] GET /identity/v3/users/25f6621aea124bc6966d554a6f0755a3 => generated 297 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:42.167688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca45295-2b46-4e75-8675-86e9efea30aa admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.173014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a86efe-22de-4470-8515-6ad6db619249 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.178576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00968534-0a63-404b-9bf9-fa15df3e36e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.179027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00968534-0a63-404b-9bf9-fa15df3e36e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.179308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00968534-0a63-404b-9bf9-fa15df3e36e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.179578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00968534-0a63-404b-9bf9-fa15df3e36e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.180596 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00968534-0a63-404b-9bf9-fa15df3e36e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:42.182612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00968534-0a63-404b-9bf9-fa15df3e36e0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:42.185905 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca45295-2b46-4e75-8675-86e9efea30aa admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.189174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772712a-f99b-4657-9760-0fabe96681ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.189737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772712a-f99b-4657-9760-0fabe96681ec admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.190607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772712a-f99b-4657-9760-0fabe96681ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.190607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772712a-f99b-4657-9760-0fabe96681ec admin admin] PATH_INFO: `/v3/users/11b7f205875c4a47b8f6840f14d097e6` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.193042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772712a-f99b-4657-9760-0fabe96681ec admin admin] RBAC: Authorizing `identity:get_user(user_id=11b7f205875c4a47b8f6840f14d097e6)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:42.195819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772712a-f99b-4657-9760-0fabe96681ec admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:42.198450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 115/227] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:42 2021] GET /identity/v3/users/11b7f205875c4a47b8f6840f14d097e6 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:42.199377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772712a-f99b-4657-9760-0fabe96681ec admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.208145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 113/228] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:35:42 2021] POST /identity/v3/users => generated 297 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:42.209042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00968534-0a63-404b-9bf9-fa15df3e36e0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.215270 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772712a-f99b-4657-9760-0fabe96681ec admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.219874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4cd5a-c57f-4ab3-809c-380399059bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.220509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4cd5a-c57f-4ab3-809c-380399059bcc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.220958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4cd5a-c57f-4ab3-809c-380399059bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.221234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4cd5a-c57f-4ab3-809c-380399059bcc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.223920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00968534-0a63-404b-9bf9-fa15df3e36e0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.228636 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f04d33-d37e-4404-a038-4b2cd07f5642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.229570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f04d33-d37e-4404-a038-4b2cd07f5642 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.229856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f04d33-d37e-4404-a038-4b2cd07f5642 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.230127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f04d33-d37e-4404-a038-4b2cd07f5642 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.230242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4cd5a-c57f-4ab3-809c-380399059bcc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:42.231446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f04d33-d37e-4404-a038-4b2cd07f5642 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:42.231944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4cd5a-c57f-4ab3-809c-380399059bcc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:42.236089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f04d33-d37e-4404-a038-4b2cd07f5642 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:42.236089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 114/229] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:42 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:42.242750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f04d33-d37e-4404-a038-4b2cd07f5642 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.248704 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 116/230] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:42.255336 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4cd5a-c57f-4ab3-809c-380399059bcc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.259611 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f04d33-d37e-4404-a038-4b2cd07f5642 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.264788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4cd5a-c57f-4ab3-809c-380399059bcc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.269811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2cba8-e645-4c3b-bfcd-e03083699107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.270011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ac296-0bf0-4296-ac21-8e65269a7841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.270899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ac296-0bf0-4296-ac21-8e65269a7841 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.271189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ac296-0bf0-4296-ac21-8e65269a7841 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.271459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ac296-0bf0-4296-ac21-8e65269a7841 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.271589 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2cba8-e645-4c3b-bfcd-e03083699107 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.272009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2cba8-e645-4c3b-bfcd-e03083699107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.272461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2cba8-e645-4c3b-bfcd-e03083699107 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b/users/11b7f205875c4a47b8f6840f14d097e6/roles/aa4c4022e45a4188814d7840a56322eb` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.272753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ac296-0bf0-4296-ac21-8e65269a7841 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:42.275369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ac296-0bf0-4296-ac21-8e65269a7841 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:42.275990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2cba8-e645-4c3b-bfcd-e03083699107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1488ecfa5b54f44826bde312726eb2b, user_id=11b7f205875c4a47b8f6840f14d097e6, role_id=aa4c4022e45a4188814d7840a56322eb)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:42.277540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 117/231] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:42 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:42.279412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a2cba8-e645-4c3b-bfcd-e03083699107 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:42.287867 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ac296-0bf0-4296-ac21-8e65269a7841 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:42.300718 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ac296-0bf0-4296-ac21-8e65269a7841 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:42.303991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 115/232] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:35:42 2021] PUT /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b/users/11b7f205875c4a47b8f6840f14d097e6/roles/aa4c4022e45a4188814d7840a56322eb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:35:42.382300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fd780-a6f3-4e3a-8235-b11f382cce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:42.382984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd780-a6f3-4e3a-8235-b11f382cce8c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:42.383299 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd780-a6f3-4e3a-8235-b11f382cce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:42.383574 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd780-a6f3-4e3a-8235-b11f382cce8c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:42.384520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fd780-a6f3-4e3a-8235-b11f382cce8c admin admin] RBAC: Adding query filter params (role.id=13af8820459545b2b1e4cea1afea8775, scope.project.id=d1488ecfa5b54f44826bde312726eb2b, user.id=25f6621aea124bc6966d554a6f0755a3) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:42.384875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fd780-a6f3-4e3a-8235-b11f382cce8c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:42.387057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fd780-a6f3-4e3a-8235-b11f382cce8c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:42.394301 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 118/233] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:42 2021] GET /identity/v3/role_assignments?user.id=25f6621aea124bc6966d554a6f0755a3&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=13af8820459545b2b1e4cea1afea8775 => generated 259 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:44.694549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0300c-ea6d-4ed0-aa76-e4f6907ce407 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:44.695062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0300c-ea6d-4ed0-aa76-e4f6907ce407 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:44.695062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0300c-ea6d-4ed0-aa76-e4f6907ce407 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:44.697084 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 116/234] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:44.714646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bb02d-fa5e-44ce-aa89-95de2f64dc45 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:44.715587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bb02d-fa5e-44ce-aa89-95de2f64dc45 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:44.716066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bb02d-fa5e-44ce-aa89-95de2f64dc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:44.745556 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-058bb02d-fa5e-44ce-aa89-95de2f64dc45 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:44.747101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-058bb02d-fa5e-44ce-aa89-95de2f64dc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:44.755377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 119/235] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:44.795954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0300c-ea6d-4ed0-aa76-e4f6907ce407 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:44.818199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0300c-ea6d-4ed0-aa76-e4f6907ce407 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:44.822795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959b00-4336-4ca8-9e25-dbac18c207b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:44.823597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959b00-4336-4ca8-9e25-dbac18c207b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:44.823879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959b00-4336-4ca8-9e25-dbac18c207b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:44.824150 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b959b00-4336-4ca8-9e25-dbac18c207b0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:44.835780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b959b00-4336-4ca8-9e25-dbac18c207b0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:44.842735 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-0b959b00-4336-4ca8-9e25-dbac18c207b0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:35:44.844209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 117/236] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:35:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:44.850432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bb02d-fa5e-44ce-aa89-95de2f64dc45 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:44.859567 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bb02d-fa5e-44ce-aa89-95de2f64dc45 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:44.864068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ceed42-5df0-41a2-82d1-432150a901b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:44.864817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceed42-5df0-41a2-82d1-432150a901b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:44.865097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceed42-5df0-41a2-82d1-432150a901b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:44.865372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ceed42-5df0-41a2-82d1-432150a901b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:44.866142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ceed42-5df0-41a2-82d1-432150a901b7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:44.866446 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ceed42-5df0-41a2-82d1-432150a901b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:44.868204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ceed42-5df0-41a2-82d1-432150a901b7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:44.877974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 120/237] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:44.884524 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959b00-4336-4ca8-9e25-dbac18c207b0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:44.895306 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b959b00-4336-4ca8-9e25-dbac18c207b0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:44.900648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fb7bf-f501-46df-8aca-5fe33c0000b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:44.901556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fb7bf-f501-46df-8aca-5fe33c0000b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:44.901835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fb7bf-f501-46df-8aca-5fe33c0000b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:44.902111 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fb7bf-f501-46df-8aca-5fe33c0000b0 admin admin] PATH_INFO: `/v3/users/11b7f205875c4a47b8f6840f14d097e6` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:44.903431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fb7bf-f501-46df-8aca-5fe33c0000b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=11b7f205875c4a47b8f6840f14d097e6)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:44.905694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fb7bf-f501-46df-8aca-5fe33c0000b0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:44.907647 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 118/238] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:44 2021] GET /identity/v3/users/11b7f205875c4a47b8f6840f14d097e6 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:44.913795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ceed42-5df0-41a2-82d1-432150a901b7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:44.926726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ceed42-5df0-41a2-82d1-432150a901b7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:44.937283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0cb57-2e91-4436-8d65-672591682f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:44.937958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0cb57-2e91-4436-8d65-672591682f81 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:44.938237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0cb57-2e91-4436-8d65-672591682f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:44.938510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0cb57-2e91-4436-8d65-672591682f81 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:44.947498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0cb57-2e91-4436-8d65-672591682f81 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:44.949237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0cb57-2e91-4436-8d65-672591682f81 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:44.963421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 121/239] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:44 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:44.964853 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fb7bf-f501-46df-8aca-5fe33c0000b0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:44.974699 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fb7bf-f501-46df-8aca-5fe33c0000b0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:44.979241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10065eaf-5fa1-4d73-9a77-141eca8636a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:44.980143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10065eaf-5fa1-4d73-9a77-141eca8636a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:44.980428 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10065eaf-5fa1-4d73-9a77-141eca8636a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:44.980743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10065eaf-5fa1-4d73-9a77-141eca8636a5 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:44.981951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10065eaf-5fa1-4d73-9a77-141eca8636a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:44.983999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10065eaf-5fa1-4d73-9a77-141eca8636a5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:44.985875 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 119/240] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:44 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:44.992124 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0cb57-2e91-4436-8d65-672591682f81 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.001230 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0cb57-2e91-4436-8d65-672591682f81 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.005707 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c799ed5-7c2d-48ea-a62e-104a40b3090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.006340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c799ed5-7c2d-48ea-a62e-104a40b3090d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.006622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c799ed5-7c2d-48ea-a62e-104a40b3090d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.006896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c799ed5-7c2d-48ea-a62e-104a40b3090d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.007745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c799ed5-7c2d-48ea-a62e-104a40b3090d admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=d1488ecfa5b54f44826bde312726eb2b, user.id=11b7f205875c4a47b8f6840f14d097e6) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:45.008175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c799ed5-7c2d-48ea-a62e-104a40b3090d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.010139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c799ed5-7c2d-48ea-a62e-104a40b3090d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.017036 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 122/241] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:44 2021] GET /identity/v3/role_assignments?user.id=11b7f205875c4a47b8f6840f14d097e6&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=f3311ba27a464113b884aa5a1144945d => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:45.145051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ace674-62b3-41a3-9664-4ee5569ce757 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.145400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ace674-62b3-41a3-9664-4ee5569ce757 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.145609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ace674-62b3-41a3-9664-4ee5569ce757 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.147412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 120/242] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:45.153819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51fd39-ef78-42c1-a523-a6af4e01885c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.154101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51fd39-ef78-42c1-a523-a6af4e01885c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.154372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d51fd39-ef78-42c1-a523-a6af4e01885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.189083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9d51fd39-ef78-42c1-a523-a6af4e01885c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:45.190317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9d51fd39-ef78-42c1-a523-a6af4e01885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:45.199036 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 123/243] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:45.223017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ace674-62b3-41a3-9664-4ee5569ce757 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.239298 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ace674-62b3-41a3-9664-4ee5569ce757 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.245707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b241c81-bc8b-4eda-8a03-26b0dd7c891a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.246564 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b241c81-bc8b-4eda-8a03-26b0dd7c891a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.246843 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b241c81-bc8b-4eda-8a03-26b0dd7c891a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.247115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b241c81-bc8b-4eda-8a03-26b0dd7c891a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.263931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b241c81-bc8b-4eda-8a03-26b0dd7c891a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:45.271654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-2b241c81-bc8b-4eda-8a03-26b0dd7c891a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:35:45.273119 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 121/244] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:45.279441 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51fd39-ef78-42c1-a523-a6af4e01885c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.288524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d51fd39-ef78-42c1-a523-a6af4e01885c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.293066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a301d-dfc2-4eed-bf0b-0c409d046ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.293738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a301d-dfc2-4eed-bf0b-0c409d046ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.294019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a301d-dfc2-4eed-bf0b-0c409d046ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.294293 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a301d-dfc2-4eed-bf0b-0c409d046ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.295069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a301d-dfc2-4eed-bf0b-0c409d046ed7 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:45.295374 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a301d-dfc2-4eed-bf0b-0c409d046ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.297046 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a301d-dfc2-4eed-bf0b-0c409d046ed7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.310885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 124/245] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:45.312358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b241c81-bc8b-4eda-8a03-26b0dd7c891a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.324065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b241c81-bc8b-4eda-8a03-26b0dd7c891a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.327450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23013eb2-5f57-4593-a29d-122ccc05647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.328324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013eb2-5f57-4593-a29d-122ccc05647e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.328621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013eb2-5f57-4593-a29d-122ccc05647e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.328898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23013eb2-5f57-4593-a29d-122ccc05647e admin admin] PATH_INFO: `/v3/users/11b7f205875c4a47b8f6840f14d097e6` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.330128 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23013eb2-5f57-4593-a29d-122ccc05647e admin admin] RBAC: Authorizing `identity:get_user(user_id=11b7f205875c4a47b8f6840f14d097e6)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.334105 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23013eb2-5f57-4593-a29d-122ccc05647e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.334682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 122/246] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/users/11b7f205875c4a47b8f6840f14d097e6 => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:45.339476 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e740-edb8-4c93-99ca-c88a1e552742 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.339767 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e740-edb8-4c93-99ca-c88a1e552742 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.340046 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe73e740-edb8-4c93-99ca-c88a1e552742 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.341614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23013eb2-5f57-4593-a29d-122ccc05647e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.342233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 125/247] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:45.348225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ad2d-0c61-49df-adf6-b2e0338a4812 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.348504 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ad2d-0c61-49df-adf6-b2e0338a4812 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.348812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4ad2d-0c61-49df-adf6-b2e0338a4812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.357675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23013eb2-5f57-4593-a29d-122ccc05647e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.362997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffa171-976b-4e58-9135-a38f3e83c83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.363917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffa171-976b-4e58-9135-a38f3e83c83d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.364202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffa171-976b-4e58-9135-a38f3e83c83d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.364473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffa171-976b-4e58-9135-a38f3e83c83d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.367645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-aab4ad2d-0c61-49df-adf6-b2e0338a4812 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:45.368995 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-aab4ad2d-0c61-49df-adf6-b2e0338a4812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:45.373621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffa171-976b-4e58-9135-a38f3e83c83d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.375474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffa171-976b-4e58-9135-a38f3e83c83d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.379630 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 126/248] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:45.386531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 123/249] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:45.393004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4ad2d-0c61-49df-adf6-b2e0338a4812 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.400581 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b29af-6cf4-4bd1-a6e7-d9b248c80c9f None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.400896 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b29af-6cf4-4bd1-a6e7-d9b248c80c9f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.401175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b29af-6cf4-4bd1-a6e7-d9b248c80c9f None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.403177 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 124/250] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:45.403830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4ad2d-0c61-49df-adf6-b2e0338a4812 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.408979 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ed12-4949-4cb3-bf19-288a0a0a4e69 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.409341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ed12-4949-4cb3-bf19-288a0a0a4e69 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.409811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1ed12-4949-4cb3-bf19-288a0a0a4e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.410095 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c39f-14f2-4bd5-950c-fedc5bd1eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.410987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c39f-14f2-4bd5-950c-fedc5bd1eef5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.411260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c39f-14f2-4bd5-950c-fedc5bd1eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.411503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1c39f-14f2-4bd5-950c-fedc5bd1eef5 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.412744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1c39f-14f2-4bd5-950c-fedc5bd1eef5 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.414978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1c39f-14f2-4bd5-950c-fedc5bd1eef5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.417788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 127/251] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:45.417788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c39f-14f2-4bd5-950c-fedc5bd1eef5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.428182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1c39f-14f2-4bd5-950c-fedc5bd1eef5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.429273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-1ea1ed12-4949-4cb3-bf19-288a0a0a4e69 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:45.431189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1ea1ed12-4949-4cb3-bf19-288a0a0a4e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:45.432918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948afa3-7bfa-43f3-9194-f7838713b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.433711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948afa3-7bfa-43f3-9194-f7838713b6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.434006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948afa3-7bfa-43f3-9194-f7838713b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.434261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948afa3-7bfa-43f3-9194-f7838713b6d0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.435426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948afa3-7bfa-43f3-9194-f7838713b6d0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.437158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948afa3-7bfa-43f3-9194-f7838713b6d0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.438744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 128/252] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:45.439476 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948afa3-7bfa-43f3-9194-f7838713b6d0 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.441369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 125/253] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:45.445893 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1ed12-4949-4cb3-bf19-288a0a0a4e69 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.451231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948afa3-7bfa-43f3-9194-f7838713b6d0 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.455907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1ed12-4949-4cb3-bf19-288a0a0a4e69 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.457066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da8b44-0ab5-4944-bac0-c53c667129e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.457941 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da8b44-0ab5-4944-bac0-c53c667129e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.458363 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da8b44-0ab5-4944-bac0-c53c667129e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.458830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da8b44-0ab5-4944-bac0-c53c667129e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.459921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da8b44-0ab5-4944-bac0-c53c667129e7 admin admin] RBAC: Adding query filter params (role.id=aa4c4022e45a4188814d7840a56322eb, scope.project.id=d1488ecfa5b54f44826bde312726eb2b, user.id=11b7f205875c4a47b8f6840f14d097e6) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:45.460459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da8b44-0ab5-4944-bac0-c53c667129e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.460887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec91bf-cb36-48d7-a825-82d5b1314bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.461823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec91bf-cb36-48d7-a825-82d5b1314bda admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.462119 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec91bf-cb36-48d7-a825-82d5b1314bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.462504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec91bf-cb36-48d7-a825-82d5b1314bda admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.463309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec91bf-cb36-48d7-a825-82d5b1314bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.464710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da8b44-0ab5-4944-bac0-c53c667129e7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.465387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec91bf-cb36-48d7-a825-82d5b1314bda admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.472550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 129/254] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/role_assignments?user.id=11b7f205875c4a47b8f6840f14d097e6&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=aa4c4022e45a4188814d7840a56322eb => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:45.473667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da8b44-0ab5-4944-bac0-c53c667129e7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.492021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da8b44-0ab5-4944-bac0-c53c667129e7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.494612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 126/255] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:35:45 2021] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:45.497273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9bf68-b9cd-4a52-9573-52c6a3340beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.498084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9bf68-b9cd-4a52-9573-52c6a3340beb admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.498364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9bf68-b9cd-4a52-9573-52c6a3340beb admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.498636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9bf68-b9cd-4a52-9573-52c6a3340beb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.517193 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c9bf68-b9cd-4a52-9573-52c6a3340beb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:45.524591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-b2c9bf68-b9cd-4a52-9573-52c6a3340beb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:45.525905 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 130/256] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:45.532676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec91bf-cb36-48d7-a825-82d5b1314bda admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.543381 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec91bf-cb36-48d7-a825-82d5b1314bda admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.548837 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204edb4c-b795-440c-944c-efd6743fde55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.549748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204edb4c-b795-440c-944c-efd6743fde55 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.550185 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204edb4c-b795-440c-944c-efd6743fde55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.550468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204edb4c-b795-440c-944c-efd6743fde55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.551352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204edb4c-b795-440c-944c-efd6743fde55 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:45.551638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204edb4c-b795-440c-944c-efd6743fde55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.553600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204edb4c-b795-440c-944c-efd6743fde55 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.564021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 127/257] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:45.570672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9bf68-b9cd-4a52-9573-52c6a3340beb admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.582879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9bf68-b9cd-4a52-9573-52c6a3340beb admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.588095 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a473ca1-45b9-4a9a-b357-9cdbf6242b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.589136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a473ca1-45b9-4a9a-b357-9cdbf6242b6f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.589466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a473ca1-45b9-4a9a-b357-9cdbf6242b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.589790 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a473ca1-45b9-4a9a-b357-9cdbf6242b6f admin admin] PATH_INFO: `/v3/users/25f6621aea124bc6966d554a6f0755a3` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.591180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a473ca1-45b9-4a9a-b357-9cdbf6242b6f admin admin] RBAC: Authorizing `identity:get_user(user_id=25f6621aea124bc6966d554a6f0755a3)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.593698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a473ca1-45b9-4a9a-b357-9cdbf6242b6f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.595531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 131/258] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/users/25f6621aea124bc6966d554a6f0755a3 => generated 297 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:45.602360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204edb4c-b795-440c-944c-efd6743fde55 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.613716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204edb4c-b795-440c-944c-efd6743fde55 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.618946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c44fdb-96bb-44fe-8a7e-3e6641eaca74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.619949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44fdb-96bb-44fe-8a7e-3e6641eaca74 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.620234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44fdb-96bb-44fe-8a7e-3e6641eaca74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.620507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c44fdb-96bb-44fe-8a7e-3e6641eaca74 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.621946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c44fdb-96bb-44fe-8a7e-3e6641eaca74 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.624263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c44fdb-96bb-44fe-8a7e-3e6641eaca74 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.626753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 128/259] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:45.633281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a473ca1-45b9-4a9a-b357-9cdbf6242b6f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.644544 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a473ca1-45b9-4a9a-b357-9cdbf6242b6f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.649868 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a306a0a-a831-4e82-b438-4081b24fbc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.650852 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306a0a-a831-4e82-b438-4081b24fbc40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.651131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306a0a-a831-4e82-b438-4081b24fbc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.651457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a306a0a-a831-4e82-b438-4081b24fbc40 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b/users/25f6621aea124bc6966d554a6f0755a3/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.653755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a306a0a-a831-4e82-b438-4081b24fbc40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1488ecfa5b54f44826bde312726eb2b, user_id=25f6621aea124bc6966d554a6f0755a3, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.656856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a306a0a-a831-4e82-b438-4081b24fbc40 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.678914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 132/260] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:35:45 2021] PUT /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b/users/25f6621aea124bc6966d554a6f0755a3/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:35:45.690999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b7ff-2ab3-4546-a687-64ac3a393eb0 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.691329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b7ff-2ab3-4546-a687-64ac3a393eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.691542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b7ff-2ab3-4546-a687-64ac3a393eb0 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.693927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 129/261] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:45.701159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05d26-c5de-4187-9e1f-cbb564f03423 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.701612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05d26-c5de-4187-9e1f-cbb564f03423 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.701831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b05d26-c5de-4187-9e1f-cbb564f03423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.726285 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-00b05d26-c5de-4187-9e1f-cbb564f03423 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:45.727970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-00b05d26-c5de-4187-9e1f-cbb564f03423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:45.798805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 133/262] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:45.822948 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6b7ff-2ab3-4546-a687-64ac3a393eb0 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.835850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6b7ff-2ab3-4546-a687-64ac3a393eb0 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.840367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cc754-2b48-459d-b421-24aeeb1e2008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.841214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cc754-2b48-459d-b421-24aeeb1e2008 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.841484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cc754-2b48-459d-b421-24aeeb1e2008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.841753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cc754-2b48-459d-b421-24aeeb1e2008 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.856969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cc754-2b48-459d-b421-24aeeb1e2008 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:45.864129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-050cc754-2b48-459d-b421-24aeeb1e2008 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 13 16:35:45.865782 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 130/263] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:45.872291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b05d26-c5de-4187-9e1f-cbb564f03423 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.883815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b05d26-c5de-4187-9e1f-cbb564f03423 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.889338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0a8e-a8b1-4ba7-8666-23cd4084c332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.890041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0a8e-a8b1-4ba7-8666-23cd4084c332 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.890318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0a8e-a8b1-4ba7-8666-23cd4084c332 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.890589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee0a8e-a8b1-4ba7-8666-23cd4084c332 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.891725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee0a8e-a8b1-4ba7-8666-23cd4084c332 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:45.892021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee0a8e-a8b1-4ba7-8666-23cd4084c332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.893697 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee0a8e-a8b1-4ba7-8666-23cd4084c332 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.904706 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 134/264] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:45.910853 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cc754-2b48-459d-b421-24aeeb1e2008 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.922135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cc754-2b48-459d-b421-24aeeb1e2008 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.929141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c808f9-0891-4f48-85e1-51e4c94d0db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.930086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c808f9-0891-4f48-85e1-51e4c94d0db6 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.930359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c808f9-0891-4f48-85e1-51e4c94d0db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.930627 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c808f9-0891-4f48-85e1-51e4c94d0db6 admin admin] PATH_INFO: `/v3/users/da74cf12004644cfad9c724435596854` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.945422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c808f9-0891-4f48-85e1-51e4c94d0db6 admin admin] RBAC: Authorizing `identity:get_user(user_id=da74cf12004644cfad9c724435596854)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.947749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c808f9-0891-4f48-85e1-51e4c94d0db6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.949941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 131/265] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/users/da74cf12004644cfad9c724435596854 => generated 297 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:45.956184 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0a8e-a8b1-4ba7-8666-23cd4084c332 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:45.966595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee0a8e-a8b1-4ba7-8666-23cd4084c332 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:45.971556 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36998b5c-6134-45b2-b61a-e4df5d28bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:45.972483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998b5c-6134-45b2-b61a-e4df5d28bedf admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:45.973019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998b5c-6134-45b2-b61a-e4df5d28bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:45.973465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998b5c-6134-45b2-b61a-e4df5d28bedf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:45.984077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36998b5c-6134-45b2-b61a-e4df5d28bedf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:45.986346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36998b5c-6134-45b2-b61a-e4df5d28bedf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:45.996762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 135/266] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:45 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:46.002969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c808f9-0891-4f48-85e1-51e4c94d0db6 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:46.014442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c808f9-0891-4f48-85e1-51e4c94d0db6 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:46.019254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c39e7e-ad31-4f51-bdfc-504cbf19fe59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:46.020160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39e7e-ad31-4f51-bdfc-504cbf19fe59 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:46.020436 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39e7e-ad31-4f51-bdfc-504cbf19fe59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:46.020781 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c39e7e-ad31-4f51-bdfc-504cbf19fe59 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:46.021976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c39e7e-ad31-4f51-bdfc-504cbf19fe59 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:46.024198 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c39e7e-ad31-4f51-bdfc-504cbf19fe59 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:46.026422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 132/267] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:46 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:46.032823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36998b5c-6134-45b2-b61a-e4df5d28bedf admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:46.042589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36998b5c-6134-45b2-b61a-e4df5d28bedf admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:46.047396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd6d00-9ff0-4a38-a718-70f0994828fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:46.048259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6d00-9ff0-4a38-a718-70f0994828fc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:46.048738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6d00-9ff0-4a38-a718-70f0994828fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:46.049153 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd6d00-9ff0-4a38-a718-70f0994828fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:46.050260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd6d00-9ff0-4a38-a718-70f0994828fc admin admin] RBAC: Adding query filter params (role.id=59ca0f318c444b35add02b8d1f75c421, scope.project.id=d1488ecfa5b54f44826bde312726eb2b, user.id=da74cf12004644cfad9c724435596854) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:46.050755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd6d00-9ff0-4a38-a718-70f0994828fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:46.052877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd6d00-9ff0-4a38-a718-70f0994828fc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:46.059638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 136/268] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:46 2021] GET /identity/v3/role_assignments?user.id=da74cf12004644cfad9c724435596854&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=59ca0f318c444b35add02b8d1f75c421 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:48.082732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6942-93f5-4d7c-a853-2809c50c35ac None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.083291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6942-93f5-4d7c-a853-2809c50c35ac None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.083291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6942-93f5-4d7c-a853-2809c50c35ac None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.085335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 133/269] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:48.087717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfa184-18b3-459b-a9f4-bdf26e056540 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.088141 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfa184-18b3-459b-a9f4-bdf26e056540 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.088308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfa184-18b3-459b-a9f4-bdf26e056540 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.090445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 137/270] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:48.092322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab69839-06ac-46c8-b44e-8f64b64730bd None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.092753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab69839-06ac-46c8-b44e-8f64b64730bd None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.093040 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab69839-06ac-46c8-b44e-8f64b64730bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.096241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df706e2a-ad5b-4740-95f4-639a6b136255 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.096525 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df706e2a-ad5b-4740-95f4-639a6b136255 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.096840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df706e2a-ad5b-4740-95f4-639a6b136255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.116778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-4ab69839-06ac-46c8-b44e-8f64b64730bd None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:48.118738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-df706e2a-ad5b-4740-95f4-639a6b136255 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:48.118995 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-4ab69839-06ac-46c8-b44e-8f64b64730bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:48.119879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-df706e2a-ad5b-4740-95f4-639a6b136255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:48.127738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 138/271] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:48.128943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 134/272] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:48.138182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca9321-3331-4b78-a0d4-57e9cdfce641 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.138470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca9321-3331-4b78-a0d4-57e9cdfce641 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.138743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca9321-3331-4b78-a0d4-57e9cdfce641 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.140755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 139/273] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:48.146795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac92b68-da39-4de1-a7ad-a68c9c7f7f98 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.147084 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac92b68-da39-4de1-a7ad-a68c9c7f7f98 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.147354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac92b68-da39-4de1-a7ad-a68c9c7f7f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.152677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca9321-3331-4b78-a0d4-57e9cdfce641 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.165026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca9321-3331-4b78-a0d4-57e9cdfce641 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.166632 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-6ac92b68-da39-4de1-a7ad-a68c9c7f7f98 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:48.167820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6ac92b68-da39-4de1-a7ad-a68c9c7f7f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:48.169427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27606eb-18d3-4794-acaf-136b5ac5edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.170206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27606eb-18d3-4794-acaf-136b5ac5edd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.170482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27606eb-18d3-4794-acaf-136b5ac5edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.170751 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27606eb-18d3-4794-acaf-136b5ac5edd7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.175718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 135/274] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:48.176225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac92b68-da39-4de1-a7ad-a68c9c7f7f98 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.187053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac92b68-da39-4de1-a7ad-a68c9c7f7f98 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.188679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27606eb-18d3-4794-acaf-136b5ac5edd7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:48.192062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c665b93-cf2f-44cd-aed4-dcd784ea1c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.193112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c665b93-cf2f-44cd-aed4-dcd784ea1c7e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.193590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c665b93-cf2f-44cd-aed4-dcd784ea1c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.194053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c665b93-cf2f-44cd-aed4-dcd784ea1c7e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.195626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-b27606eb-18d3-4794-acaf-136b5ac5edd7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:48.197561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 140/275] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:35:48.203046 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27606eb-18d3-4794-acaf-136b5ac5edd7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.206023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c665b93-cf2f-44cd-aed4-dcd784ea1c7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:48.212488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27606eb-18d3-4794-acaf-136b5ac5edd7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.213136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-7c665b93-cf2f-44cd-aed4-dcd784ea1c7e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:48.216721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 136/276] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:48.216721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c665b93-cf2f-44cd-aed4-dcd784ea1c7e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.222033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40dfc0-fe89-4d9a-868e-10a25969e876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.223201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40dfc0-fe89-4d9a-868e-10a25969e876 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.223201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40dfc0-fe89-4d9a-868e-10a25969e876 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.223201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40dfc0-fe89-4d9a-868e-10a25969e876 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.223986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40dfc0-fe89-4d9a-868e-10a25969e876 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:48.224291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40dfc0-fe89-4d9a-868e-10a25969e876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.225956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40dfc0-fe89-4d9a-868e-10a25969e876 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.226808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c665b93-cf2f-44cd-aed4-dcd784ea1c7e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.230966 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc89d-aafb-42bb-8e15-d5bb33ad14cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.231703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc89d-aafb-42bb-8e15-d5bb33ad14cc admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.231982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc89d-aafb-42bb-8e15-d5bb33ad14cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.232250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecbc89d-aafb-42bb-8e15-d5bb33ad14cc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.233442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbc89d-aafb-42bb-8e15-d5bb33ad14cc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.235110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecbc89d-aafb-42bb-8e15-d5bb33ad14cc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.240997 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 141/277] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:48.241110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 137/278] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:48.241181 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40dfc0-fe89-4d9a-868e-10a25969e876 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.242166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc89d-aafb-42bb-8e15-d5bb33ad14cc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.252693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecbc89d-aafb-42bb-8e15-d5bb33ad14cc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.252820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40dfc0-fe89-4d9a-868e-10a25969e876 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.256813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2602b-af4c-47ff-ba5b-8f1e6d328a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.256934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64374ff8-6f87-4bfb-9f00-8428c0ca945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.257560 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64374ff8-6f87-4bfb-9f00-8428c0ca945d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.257656 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2602b-af4c-47ff-ba5b-8f1e6d328a57 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.257837 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64374ff8-6f87-4bfb-9f00-8428c0ca945d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.257974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2602b-af4c-47ff-ba5b-8f1e6d328a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.258190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64374ff8-6f87-4bfb-9f00-8428c0ca945d admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.258281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2602b-af4c-47ff-ba5b-8f1e6d328a57 admin admin] PATH_INFO: `/v3/users/25f6621aea124bc6966d554a6f0755a3` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.258943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64374ff8-6f87-4bfb-9f00-8428c0ca945d admin admin] RBAC: Adding query filter params (name=member) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:48.259243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64374ff8-6f87-4bfb-9f00-8428c0ca945d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.259437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2602b-af4c-47ff-ba5b-8f1e6d328a57 admin admin] RBAC: Authorizing `identity:get_user(user_id=25f6621aea124bc6966d554a6f0755a3)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.260838 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64374ff8-6f87-4bfb-9f00-8428c0ca945d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.261550 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2602b-af4c-47ff-ba5b-8f1e6d328a57 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.263399 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 138/279] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/users/25f6621aea124bc6966d554a6f0755a3 => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:48.264006 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2602b-af4c-47ff-ba5b-8f1e6d328a57 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.273350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2602b-af4c-47ff-ba5b-8f1e6d328a57 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.274503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 142/280] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:48.274503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64374ff8-6f87-4bfb-9f00-8428c0ca945d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.282403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327545de-a928-4c03-bd5b-243985c8754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.283046 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327545de-a928-4c03-bd5b-243985c8754c admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.283327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327545de-a928-4c03-bd5b-243985c8754c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.283598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327545de-a928-4c03-bd5b-243985c8754c admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.284237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64374ff8-6f87-4bfb-9f00-8428c0ca945d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.284335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327545de-a928-4c03-bd5b-243985c8754c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.286279 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327545de-a928-4c03-bd5b-243985c8754c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.288342 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ba742-ce6f-4068-b2bd-bb5d2d1ed360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.288998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ba742-ce6f-4068-b2bd-bb5d2d1ed360 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.289322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ba742-ce6f-4068-b2bd-bb5d2d1ed360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.289659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ba742-ce6f-4068-b2bd-bb5d2d1ed360 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.298537 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ba742-ce6f-4068-b2bd-bb5d2d1ed360 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.300610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ba742-ce6f-4068-b2bd-bb5d2d1ed360 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.307787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 139/281] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:35:48 2021] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:35:48.308816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327545de-a928-4c03-bd5b-243985c8754c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.309937 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 143/282] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:48.316303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ba742-ce6f-4068-b2bd-bb5d2d1ed360 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.325873 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ba742-ce6f-4068-b2bd-bb5d2d1ed360 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.330451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a890e81-b70e-4bec-b2fe-ee6359fcd28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.333789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a890e81-b70e-4bec-b2fe-ee6359fcd28e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.333789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a890e81-b70e-4bec-b2fe-ee6359fcd28e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.333789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a890e81-b70e-4bec-b2fe-ee6359fcd28e admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.335053 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a890e81-b70e-4bec-b2fe-ee6359fcd28e admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.337418 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a890e81-b70e-4bec-b2fe-ee6359fcd28e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.338902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327545de-a928-4c03-bd5b-243985c8754c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.343752 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e81548-ad94-4cc9-bba9-410ac6d4a080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.345130 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81548-ad94-4cc9-bba9-410ac6d4a080 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.345266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 144/283] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:48.345756 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81548-ad94-4cc9-bba9-410ac6d4a080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.346224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e81548-ad94-4cc9-bba9-410ac6d4a080 admin admin] PATH_INFO: `/v3/users/dc5b4b91dc314f90a9c377a49994f6df` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.346326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a890e81-b70e-4bec-b2fe-ee6359fcd28e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.359646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a890e81-b70e-4bec-b2fe-ee6359fcd28e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.364065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e81548-ad94-4cc9-bba9-410ac6d4a080 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc5b4b91dc314f90a9c377a49994f6df)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.364192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa2132-f217-4561-9b18-2a97ce49719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.364985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2132-f217-4561-9b18-2a97ce49719a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.365316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2132-f217-4561-9b18-2a97ce49719a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.365587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa2132-f217-4561-9b18-2a97ce49719a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.366431 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa2132-f217-4561-9b18-2a97ce49719a admin admin] RBAC: Adding query filter params (role.id=13af8820459545b2b1e4cea1afea8775, scope.project.id=d1488ecfa5b54f44826bde312726eb2b, user.id=25f6621aea124bc6966d554a6f0755a3) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:48.366735 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa2132-f217-4561-9b18-2a97ce49719a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.368100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e81548-ad94-4cc9-bba9-410ac6d4a080 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.368788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa2132-f217-4561-9b18-2a97ce49719a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.371153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 140/284] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/users/dc5b4b91dc314f90a9c377a49994f6df => generated 293 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:48.380622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e81548-ad94-4cc9-bba9-410ac6d4a080 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.384775 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 145/285] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/role_assignments?user.id=25f6621aea124bc6966d554a6f0755a3&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=13af8820459545b2b1e4cea1afea8775 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:48.392514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e81548-ad94-4cc9-bba9-410ac6d4a080 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.397718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bbb4f-de31-43a5-9706-c9f7827a2f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.398936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbb4f-de31-43a5-9706-c9f7827a2f18 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.399445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbb4f-de31-43a5-9706-c9f7827a2f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.399907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bbb4f-de31-43a5-9706-c9f7827a2f18 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.401096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bbb4f-de31-43a5-9706-c9f7827a2f18 admin admin] RBAC: Adding query filter params (role.id=13af8820459545b2b1e4cea1afea8775, user.id=dc5b4b91dc314f90a9c377a49994f6df, scope.system=all) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:48.401703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bbb4f-de31-43a5-9706-c9f7827a2f18 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.403883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bbb4f-de31-43a5-9706-c9f7827a2f18 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.414158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 141/286] 10.222.0.62 () {56 vars in 1329 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/role_assignments?user.id=dc5b4b91dc314f90a9c377a49994f6df&scope.system=all&role.id=13af8820459545b2b1e4cea1afea8775 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:48.429690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543cb9-6487-4edc-b849-ba49bed0c96a None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.430067 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543cb9-6487-4edc-b849-ba49bed0c96a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.430294 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543cb9-6487-4edc-b849-ba49bed0c96a None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.432435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 146/287] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:48.439584 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47059234-e0ac-41f7-8834-1d2136d2328c None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.439859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47059234-e0ac-41f7-8834-1d2136d2328c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.440135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47059234-e0ac-41f7-8834-1d2136d2328c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.463230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-47059234-e0ac-41f7-8834-1d2136d2328c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:48.464555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-47059234-e0ac-41f7-8834-1d2136d2328c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:48.474161 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 142/288] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:48.499997 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46543cb9-6487-4edc-b849-ba49bed0c96a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.514300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46543cb9-6487-4edc-b849-ba49bed0c96a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.519638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec750d2-8ac3-4b79-9ada-01d07eaa5a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.520454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec750d2-8ac3-4b79-9ada-01d07eaa5a84 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.520769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec750d2-8ac3-4b79-9ada-01d07eaa5a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.521044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec750d2-8ac3-4b79-9ada-01d07eaa5a84 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.534723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec750d2-8ac3-4b79-9ada-01d07eaa5a84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:48.542784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-3ec750d2-8ac3-4b79-9ada-01d07eaa5a84 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 13 16:35:48.544112 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 147/289] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/roles/reader => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:48.551075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47059234-e0ac-41f7-8834-1d2136d2328c None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.561390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47059234-e0ac-41f7-8834-1d2136d2328c None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.566075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20315ff-e454-4bce-98c3-33bcbad256e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.566775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20315ff-e454-4bce-98c3-33bcbad256e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.567053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20315ff-e454-4bce-98c3-33bcbad256e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.567324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20315ff-e454-4bce-98c3-33bcbad256e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.568123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20315ff-e454-4bce-98c3-33bcbad256e2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:48.568428 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20315ff-e454-4bce-98c3-33bcbad256e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.570172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20315ff-e454-4bce-98c3-33bcbad256e2 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.582411 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 143/290] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:48.589847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec750d2-8ac3-4b79-9ada-01d07eaa5a84 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.600705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec750d2-8ac3-4b79-9ada-01d07eaa5a84 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.605669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee6c3b-c139-457c-a611-e54983a450fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.606577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee6c3b-c139-457c-a611-e54983a450fd admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.606859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee6c3b-c139-457c-a611-e54983a450fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.607131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee6c3b-c139-457c-a611-e54983a450fd admin admin] PATH_INFO: `/v3/users/da74cf12004644cfad9c724435596854` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.608494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee6c3b-c139-457c-a611-e54983a450fd admin admin] RBAC: Authorizing `identity:get_user(user_id=da74cf12004644cfad9c724435596854)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.610767 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee6c3b-c139-457c-a611-e54983a450fd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.612655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 148/291] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/users/da74cf12004644cfad9c724435596854 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:48.619990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20315ff-e454-4bce-98c3-33bcbad256e2 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.630444 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20315ff-e454-4bce-98c3-33bcbad256e2 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.635896 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9bfca-bd5b-481d-b3cb-6b67b045bfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.636815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bfca-bd5b-481d-b3cb-6b67b045bfdd admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.637094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bfca-bd5b-481d-b3cb-6b67b045bfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.637365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bfca-bd5b-481d-b3cb-6b67b045bfdd admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.638749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9bfca-bd5b-481d-b3cb-6b67b045bfdd admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.641365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9bfca-bd5b-481d-b3cb-6b67b045bfdd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.643226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 144/292] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:48 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:48.650699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee6c3b-c139-457c-a611-e54983a450fd admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:48.662441 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee6c3b-c139-457c-a611-e54983a450fd admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:48.667058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efef8f-e34d-4153-95b4-0d264a955dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:48.667956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efef8f-e34d-4153-95b4-0d264a955dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:48.668233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efef8f-e34d-4153-95b4-0d264a955dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:48.668504 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efef8f-e34d-4153-95b4-0d264a955dc8 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b/users/da74cf12004644cfad9c724435596854/roles/59ca0f318c444b35add02b8d1f75c421` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:48.670622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efef8f-e34d-4153-95b4-0d264a955dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1488ecfa5b54f44826bde312726eb2b, user_id=da74cf12004644cfad9c724435596854, role_id=59ca0f318c444b35add02b8d1f75c421)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:48.673317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efef8f-e34d-4153-95b4-0d264a955dc8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:48.692321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 149/293] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:35:48 2021] PUT /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b/users/da74cf12004644cfad9c724435596854/roles/59ca0f318c444b35add02b8d1f75c421 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:35:50.879354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d2c2f-f1a9-4f4e-8cab-5a40efd1e0a5 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:50.880378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d2c2f-f1a9-4f4e-8cab-5a40efd1e0a5 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:50.880882 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d2c2f-f1a9-4f4e-8cab-5a40efd1e0a5 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:50.883935 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 145/294] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:50.890111 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd15d7-9ed2-415f-a82d-81f7360fa702 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:50.891300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd15d7-9ed2-415f-a82d-81f7360fa702 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:50.891796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd15d7-9ed2-415f-a82d-81f7360fa702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:50.910239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c9bd15d7-9ed2-415f-a82d-81f7360fa702 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:50.911744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c9bd15d7-9ed2-415f-a82d-81f7360fa702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:50.946765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983908-7c0b-433c-a0c1-03bca923a74b None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:50.947101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983908-7c0b-433c-a0c1-03bca923a74b None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:50.947316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983908-7c0b-433c-a0c1-03bca923a74b None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:50.949526 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 146/295] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:50.955114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0dee0-3e71-497a-a811-88e0f67fd3f6 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:50.955398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0dee0-3e71-497a-a811-88e0f67fd3f6 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:50.955668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0dee0-3e71-497a-a811-88e0f67fd3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:50.972142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 150/296] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:50.981655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-80b0dee0-3e71-497a-a811-88e0f67fd3f6 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:50.983099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-80b0dee0-3e71-497a-a811-88e0f67fd3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:50.986250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6caf-eccf-4945-b6c0-1f1851b638ee None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:50.986542 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6caf-eccf-4945-b6c0-1f1851b638ee None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:50.986812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e6caf-eccf-4945-b6c0-1f1851b638ee None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:50.992068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 147/298] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:50.992189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 151/298] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:35:50.995506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c722c-6fd5-4f0e-8a59-8d189e1ce399 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:50.995506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c722c-6fd5-4f0e-8a59-8d189e1ce399 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:50.995705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c722c-6fd5-4f0e-8a59-8d189e1ce399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:50.997168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0dee0-3e71-497a-a811-88e0f67fd3f6 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.008001 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0dee0-3e71-497a-a811-88e0f67fd3f6 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.012629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929a71-eb00-4cf2-a7f9-c8404a440171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.013438 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929a71-eb00-4cf2-a7f9-c8404a440171 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.013717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929a71-eb00-4cf2-a7f9-c8404a440171 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.014027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16929a71-eb00-4cf2-a7f9-c8404a440171 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.015278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-bb6c722c-6fd5-4f0e-8a59-8d189e1ce399 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:51.016831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bb6c722c-6fd5-4f0e-8a59-8d189e1ce399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:51.024557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 152/299] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:51.025236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c722c-6fd5-4f0e-8a59-8d189e1ce399 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.030138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16929a71-eb00-4cf2-a7f9-c8404a440171 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:51.034194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c722c-6fd5-4f0e-8a59-8d189e1ce399 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.038435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-16929a71-eb00-4cf2-a7f9-c8404a440171 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:51.038540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553e326-185d-4ff2-a4c3-836b59904581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.039250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553e326-185d-4ff2-a4c3-836b59904581 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.039530 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553e326-185d-4ff2-a4c3-836b59904581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.039799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553e326-185d-4ff2-a4c3-836b59904581 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.040991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553e326-185d-4ff2-a4c3-836b59904581 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.041092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 148/300] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:35:51.046356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553e326-185d-4ff2-a4c3-836b59904581 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.046356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 153/301] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:51.047537 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929a71-eb00-4cf2-a7f9-c8404a440171 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.049888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553e326-185d-4ff2-a4c3-836b59904581 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.057796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16929a71-eb00-4cf2-a7f9-c8404a440171 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.060644 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553e326-185d-4ff2-a4c3-836b59904581 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.062659 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef277b99-8942-42d3-8087-45abd7668eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.063347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef277b99-8942-42d3-8087-45abd7668eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.063587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef277b99-8942-42d3-8087-45abd7668eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.063855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef277b99-8942-42d3-8087-45abd7668eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.064655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef277b99-8942-42d3-8087-45abd7668eb2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:51.064957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef277b99-8942-42d3-8087-45abd7668eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.065104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e7453-66e1-4fb1-811b-87b109c6df29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.065717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e7453-66e1-4fb1-811b-87b109c6df29 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.065997 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e7453-66e1-4fb1-811b-87b109c6df29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.066269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e7453-66e1-4fb1-811b-87b109c6df29 admin admin] PATH_INFO: `/v3/groups` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.066553 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef277b99-8942-42d3-8087-45abd7668eb2 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.066966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e7453-66e1-4fb1-811b-87b109c6df29 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.067989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-913e7453-66e1-4fb1-811b-87b109c6df29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:51.067989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:35:51.067989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:35:51.069171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e7453-66e1-4fb1-811b-87b109c6df29 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.076114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 149/302] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:51.077036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef277b99-8942-42d3-8087-45abd7668eb2 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.086915 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef277b99-8942-42d3-8087-45abd7668eb2 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.087311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 154/303] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Dec 13 16:35:51 2021] POST /identity/v3/groups => generated 229 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:35:51.088676 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f1ee-4228-408d-b283-577402804801 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.088965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f1ee-4228-408d-b283-577402804801 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.089235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77f1ee-4228-408d-b283-577402804801 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.091003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 155/304] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:51.092690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f1ee-4228-408d-b283-577402804801 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.098965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f50bc3-bc5d-4dbd-bc47-c03f51e4fd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.099796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50bc3-bc5d-4dbd-bc47-c03f51e4fd00 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.100072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50bc3-bc5d-4dbd-bc47-c03f51e4fd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.100339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f50bc3-bc5d-4dbd-bc47-c03f51e4fd00 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.106203 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77f1ee-4228-408d-b283-577402804801 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.110590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eba94b-548d-46b9-b77f-2e1e54758dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.111481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eba94b-548d-46b9-b77f-2e1e54758dfd admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.111761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eba94b-548d-46b9-b77f-2e1e54758dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.112033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eba94b-548d-46b9-b77f-2e1e54758dfd admin admin] PATH_INFO: `/v3/users/dc5b4b91dc314f90a9c377a49994f6df` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.112505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f50bc3-bc5d-4dbd-bc47-c03f51e4fd00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:51.113364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eba94b-548d-46b9-b77f-2e1e54758dfd admin admin] RBAC: Authorizing `identity:get_user(user_id=dc5b4b91dc314f90a9c377a49994f6df)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.115536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eba94b-548d-46b9-b77f-2e1e54758dfd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.117634 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 156/305] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/users/dc5b4b91dc314f90a9c377a49994f6df => generated 293 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:51.119580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-e2f50bc3-bc5d-4dbd-bc47-c03f51e4fd00 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 13 16:35:51.119701 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd482-5cdd-45c9-938c-9c1fe338baed None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.119861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd482-5cdd-45c9-938c-9c1fe338baed None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.120136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdd482-5cdd-45c9-938c-9c1fe338baed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.120949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 150/306] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/roles/reader => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:51.125804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f50bc3-bc5d-4dbd-bc47-c03f51e4fd00 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.136520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f50bc3-bc5d-4dbd-bc47-c03f51e4fd00 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.141306 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a90080-bde7-4a6f-a959-d0854bef22dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.142186 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a90080-bde7-4a6f-a959-d0854bef22dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.142461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a90080-bde7-4a6f-a959-d0854bef22dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.142727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a90080-bde7-4a6f-a959-d0854bef22dd admin admin] PATH_INFO: `/v3/system/users/dc5b4b91dc314f90a9c377a49994f6df/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.143962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e6cdd482-5cdd-45c9-938c-9c1fe338baed None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:51.144213 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a90080-bde7-4a6f-a959-d0854bef22dd admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dc5b4b91dc314f90a9c377a49994f6df, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.145194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e6cdd482-5cdd-45c9-938c-9c1fe338baed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:51.145290 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-b8a90080-bde7-4a6f-a959-d0854bef22dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:51.145290 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:35:51.145290 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:35:51.146162 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a90080-bde7-4a6f-a959-d0854bef22dd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.154974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 157/307] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:51 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:51.155391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd482-5cdd-45c9-938c-9c1fe338baed None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.164097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 151/308] 10.222.0.62 () {58 vars in 1355 bytes} [Mon Dec 13 16:35:51 2021] PUT /identity/v3/system/users/dc5b4b91dc314f90a9c377a49994f6df/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:35:51.168164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdd482-5cdd-45c9-938c-9c1fe338baed None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.180212 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a90080-bde7-4a6f-a959-d0854bef22dd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.187851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7b7be-75cb-4a94-8997-b7f45f2e91e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.189035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7b7be-75cb-4a94-8997-b7f45f2e91e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.189517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7b7be-75cb-4a94-8997-b7f45f2e91e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.190092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad7b7be-75cb-4a94-8997-b7f45f2e91e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.191113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a90080-bde7-4a6f-a959-d0854bef22dd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.191402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7b7be-75cb-4a94-8997-b7f45f2e91e5 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:51.191897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7b7be-75cb-4a94-8997-b7f45f2e91e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.193808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad7b7be-75cb-4a94-8997-b7f45f2e91e5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.195994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a5357-4a40-46f4-8c62-242a03b105f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.196863 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5357-4a40-46f4-8c62-242a03b105f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.197141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5357-4a40-46f4-8c62-242a03b105f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.197407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a5357-4a40-46f4-8c62-242a03b105f5 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.210650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a5357-4a40-46f4-8c62-242a03b105f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:51.214446 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 158/309] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:51.220625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-ea1a5357-4a40-46f4-8c62-242a03b105f5 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 13 16:35:51.220625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 152/310] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:35:51.226206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7b7be-75cb-4a94-8997-b7f45f2e91e5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.226407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a5357-4a40-46f4-8c62-242a03b105f5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.238078 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a5357-4a40-46f4-8c62-242a03b105f5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.238829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad7b7be-75cb-4a94-8997-b7f45f2e91e5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.243943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081162ed-3a8f-477e-ab6f-dcaeb001ea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.244310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784688-e9e7-4048-a0a4-d84a7fa6bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.245085 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081162ed-3a8f-477e-ab6f-dcaeb001ea6a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.245281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784688-e9e7-4048-a0a4-d84a7fa6bb7e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.245559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784688-e9e7-4048-a0a4-d84a7fa6bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.245829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa784688-e9e7-4048-a0a4-d84a7fa6bb7e admin admin] PATH_INFO: `/v3/users/044155a56b3a4b2385e9689f02f02d90` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.245933 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081162ed-3a8f-477e-ab6f-dcaeb001ea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.246325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081162ed-3a8f-477e-ab6f-dcaeb001ea6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.247300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081162ed-3a8f-477e-ab6f-dcaeb001ea6a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:51.247776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081162ed-3a8f-477e-ab6f-dcaeb001ea6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.249781 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081162ed-3a8f-477e-ab6f-dcaeb001ea6a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.263652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 153/311] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:51.270488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081162ed-3a8f-477e-ab6f-dcaeb001ea6a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.275334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa784688-e9e7-4048-a0a4-d84a7fa6bb7e admin admin] RBAC: Authorizing `identity:get_user(user_id=044155a56b3a4b2385e9689f02f02d90)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.281238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa784688-e9e7-4048-a0a4-d84a7fa6bb7e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.284536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 159/312] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/users/044155a56b3a4b2385e9689f02f02d90 => generated 293 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:51.290549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081162ed-3a8f-477e-ab6f-dcaeb001ea6a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.292834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784688-e9e7-4048-a0a4-d84a7fa6bb7e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.296937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da60a8-e25b-4ca2-be34-e31291f36355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.297859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da60a8-e25b-4ca2-be34-e31291f36355 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.298127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da60a8-e25b-4ca2-be34-e31291f36355 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.298388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da60a8-e25b-4ca2-be34-e31291f36355 admin admin] PATH_INFO: `/v3/users/da74cf12004644cfad9c724435596854` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.299703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da60a8-e25b-4ca2-be34-e31291f36355 admin admin] RBAC: Authorizing `identity:get_user(user_id=da74cf12004644cfad9c724435596854)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.302091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da60a8-e25b-4ca2-be34-e31291f36355 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.304024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 154/313] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/users/da74cf12004644cfad9c724435596854 => generated 297 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:51.306669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa784688-e9e7-4048-a0a4-d84a7fa6bb7e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.311738 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da60a8-e25b-4ca2-be34-e31291f36355 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.313835 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a99fb-5fe1-4878-9d55-139e3ad86b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.314876 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a99fb-5fe1-4878-9d55-139e3ad86b93 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.315394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a99fb-5fe1-4878-9d55-139e3ad86b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.315858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a99fb-5fe1-4878-9d55-139e3ad86b93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.317302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a99fb-5fe1-4878-9d55-139e3ad86b93 admin admin] RBAC: Adding query filter params (role.id=59ca0f318c444b35add02b8d1f75c421, user.id=044155a56b3a4b2385e9689f02f02d90, scope.system=all) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:51.318002 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a99fb-5fe1-4878-9d55-139e3ad86b93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.321304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a99fb-5fe1-4878-9d55-139e3ad86b93 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.323096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da60a8-e25b-4ca2-be34-e31291f36355 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.327890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852d0ba-4c84-4ace-a5fa-3d05ae464ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.329075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852d0ba-4c84-4ace-a5fa-3d05ae464ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.329075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852d0ba-4c84-4ace-a5fa-3d05ae464ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.329309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7852d0ba-4c84-4ace-a5fa-3d05ae464ed7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.333247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 160/314] 10.222.0.62 () {56 vars in 1329 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/role_assignments?user.id=044155a56b3a4b2385e9689f02f02d90&scope.system=all&role.id=59ca0f318c444b35add02b8d1f75c421 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:51.341762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852d0ba-4c84-4ace-a5fa-3d05ae464ed7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.344042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7852d0ba-4c84-4ace-a5fa-3d05ae464ed7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.355268 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 155/315] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:51.363164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a99fb-5fe1-4878-9d55-139e3ad86b93 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.374040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a99fb-5fe1-4878-9d55-139e3ad86b93 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.379076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d62d0e-5b66-4ac7-8f1e-2d23819da7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.380410 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62d0e-5b66-4ac7-8f1e-2d23819da7ba admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.380895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62d0e-5b66-4ac7-8f1e-2d23819da7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.381335 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d62d0e-5b66-4ac7-8f1e-2d23819da7ba admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.383088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d62d0e-5b66-4ac7-8f1e-2d23819da7ba admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.385473 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d62d0e-5b66-4ac7-8f1e-2d23819da7ba admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.387995 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 161/316] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:51.396614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852d0ba-4c84-4ace-a5fa-3d05ae464ed7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:51.405495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7852d0ba-4c84-4ace-a5fa-3d05ae464ed7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:51.412175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c4a56-96a9-4a1f-96cc-44c3a5d5241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:51.415638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4a56-96a9-4a1f-96cc-44c3a5d5241c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:51.415638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4a56-96a9-4a1f-96cc-44c3a5d5241c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:51.415638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4a56-96a9-4a1f-96cc-44c3a5d5241c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:51.415638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c4a56-96a9-4a1f-96cc-44c3a5d5241c admin admin] RBAC: Adding query filter params (role.id=59ca0f318c444b35add02b8d1f75c421, scope.project.id=d1488ecfa5b54f44826bde312726eb2b, user.id=da74cf12004644cfad9c724435596854) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:51.415638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c4a56-96a9-4a1f-96cc-44c3a5d5241c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:51.416883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c4a56-96a9-4a1f-96cc-44c3a5d5241c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:51.424104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 156/317] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:35:51 2021] GET /identity/v3/role_assignments?user.id=da74cf12004644cfad9c724435596854&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=59ca0f318c444b35add02b8d1f75c421 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:53.553164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d621a7-5bb2-4852-82c8-0523c024bd2b None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.553716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d621a7-5bb2-4852-82c8-0523c024bd2b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.553716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d621a7-5bb2-4852-82c8-0523c024bd2b None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.555676 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 162/318] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:53.559712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02ffe-1066-4649-a7dd-8fb27c760812 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.560112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02ffe-1066-4649-a7dd-8fb27c760812 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.560112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02ffe-1066-4649-a7dd-8fb27c760812 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.560872 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600826c7-0842-46ae-b7f0-d3d66cb26617 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.561128 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600826c7-0842-46ae-b7f0-d3d66cb26617 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.561417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600826c7-0842-46ae-b7f0-d3d66cb26617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.561987 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 157/319] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:53.567185 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42995052-a9b4-444e-b3ae-f707e3952200 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.567636 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42995052-a9b4-444e-b3ae-f707e3952200 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.567753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42995052-a9b4-444e-b3ae-f707e3952200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.579854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-600826c7-0842-46ae-b7f0-d3d66cb26617 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:53.580938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-600826c7-0842-46ae-b7f0-d3d66cb26617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:53.585557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-42995052-a9b4-444e-b3ae-f707e3952200 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:53.586834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-42995052-a9b4-444e-b3ae-f707e3952200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:53.589129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 163/320] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:53.594795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 158/321] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:53.612326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600826c7-0842-46ae-b7f0-d3d66cb26617 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:53.617800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42995052-a9b4-444e-b3ae-f707e3952200 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:53.621645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600826c7-0842-46ae-b7f0-d3d66cb26617 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:53.626391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b661c4a-7f33-4579-8371-506a775b4fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:53.626976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42995052-a9b4-444e-b3ae-f707e3952200 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:53.627496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b661c4a-7f33-4579-8371-506a775b4fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.627895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b661c4a-7f33-4579-8371-506a775b4fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.628296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b661c4a-7f33-4579-8371-506a775b4fa8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.631879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb91ae0-8cc7-4c8c-a82e-e5ce6f9b3f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:53.632721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb91ae0-8cc7-4c8c-a82e-e5ce6f9b3f16 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.633164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb91ae0-8cc7-4c8c-a82e-e5ce6f9b3f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.633563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb91ae0-8cc7-4c8c-a82e-e5ce6f9b3f16 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.634924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb91ae0-8cc7-4c8c-a82e-e5ce6f9b3f16 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:53.636637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb91ae0-8cc7-4c8c-a82e-e5ce6f9b3f16 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:53.638218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 159/322] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:35:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:53.640127 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b661c4a-7f33-4579-8371-506a775b4fa8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:53.644295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb91ae0-8cc7-4c8c-a82e-e5ce6f9b3f16 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:53.647638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-0b661c4a-7f33-4579-8371-506a775b4fa8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:53.653902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb91ae0-8cc7-4c8c-a82e-e5ce6f9b3f16 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:53.654123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 164/323] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:53 2021] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:53.655189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b661c4a-7f33-4579-8371-506a775b4fa8 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:53.658302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f26fb-1604-4b2f-a91f-c1bb42aca9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:53.658955 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f26fb-1604-4b2f-a91f-c1bb42aca9cc admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.659236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f26fb-1604-4b2f-a91f-c1bb42aca9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.659508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f26fb-1604-4b2f-a91f-c1bb42aca9cc admin admin] PATH_INFO: `/v3/groups` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.660218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f26fb-1604-4b2f-a91f-c1bb42aca9cc admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:53.661324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-070f26fb-1604-4b2f-a91f-c1bb42aca9cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:53.661324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:35:53.661324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:35:53.662397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f26fb-1604-4b2f-a91f-c1bb42aca9cc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:53.664652 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b661c4a-7f33-4579-8371-506a775b4fa8 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:53.669666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae141489-e73b-4e3d-a505-0065d6f8c079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:53.670361 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141489-e73b-4e3d-a505-0065d6f8c079 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.670618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141489-e73b-4e3d-a505-0065d6f8c079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.670914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae141489-e73b-4e3d-a505-0065d6f8c079 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.671738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae141489-e73b-4e3d-a505-0065d6f8c079 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:53.672072 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae141489-e73b-4e3d-a505-0065d6f8c079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:53.673857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae141489-e73b-4e3d-a505-0065d6f8c079 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:53.681852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 160/324] 10.222.0.62 () {60 vars in 1155 bytes} [Mon Dec 13 16:35:53 2021] POST /identity/v3/groups => generated 226 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:35:53.688211 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 165/325] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:53 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:53.689783 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f26fb-1604-4b2f-a91f-c1bb42aca9cc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:53.700113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f26fb-1604-4b2f-a91f-c1bb42aca9cc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:53.704764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8328dc5-9588-4c87-91bf-952fbb51a0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:53.705668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8328dc5-9588-4c87-91bf-952fbb51a0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.705945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8328dc5-9588-4c87-91bf-952fbb51a0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.706214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8328dc5-9588-4c87-91bf-952fbb51a0f1 admin admin] PATH_INFO: `/v3/users/dc5b4b91dc314f90a9c377a49994f6df` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.707501 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8328dc5-9588-4c87-91bf-952fbb51a0f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=dc5b4b91dc314f90a9c377a49994f6df)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:53.709698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8328dc5-9588-4c87-91bf-952fbb51a0f1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:53.711628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 161/326] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:53 2021] GET /identity/v3/users/dc5b4b91dc314f90a9c377a49994f6df => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:53.718250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae141489-e73b-4e3d-a505-0065d6f8c079 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:53.728493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae141489-e73b-4e3d-a505-0065d6f8c079 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:53.732943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f6eb7-a566-4eae-b371-52d3f04d2f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:53.733610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6eb7-a566-4eae-b371-52d3f04d2f87 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.733889 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6eb7-a566-4eae-b371-52d3f04d2f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.734162 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6eb7-a566-4eae-b371-52d3f04d2f87 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.735010 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f6eb7-a566-4eae-b371-52d3f04d2f87 admin admin] RBAC: Adding query filter params (role.id=13af8820459545b2b1e4cea1afea8775, user.id=dc5b4b91dc314f90a9c377a49994f6df, scope.system=all) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:53.735322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f6eb7-a566-4eae-b371-52d3f04d2f87 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:53.737222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f6eb7-a566-4eae-b371-52d3f04d2f87 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:53.754266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 166/327] 10.222.0.62 () {56 vars in 1329 bytes} [Mon Dec 13 16:35:53 2021] GET /identity/v3/role_assignments?user.id=dc5b4b91dc314f90a9c377a49994f6df&scope.system=all&role.id=13af8820459545b2b1e4cea1afea8775 => generated 510 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:53.764026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad0f03-3a74-455d-991b-b142891c3fff None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.764378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad0f03-3a74-455d-991b-b142891c3fff None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.764638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad0f03-3a74-455d-991b-b142891c3fff None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.767217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 162/328] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:53.775308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fec1b-f573-4070-9a2d-7f79ac6929a7 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.776023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fec1b-f573-4070-9a2d-7f79ac6929a7 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.776495 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fec1b-f573-4070-9a2d-7f79ac6929a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.797627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-4d1fec1b-f573-4070-9a2d-7f79ac6929a7 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:53.799262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4d1fec1b-f573-4070-9a2d-7f79ac6929a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:53.808137 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 167/329] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:53.832641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad0f03-3a74-455d-991b-b142891c3fff None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:53.846823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad0f03-3a74-455d-991b-b142891c3fff None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:53.851694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77fa3f-914e-458e-866a-963d9c7247a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:53.853257 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77fa3f-914e-458e-866a-963d9c7247a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.853537 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77fa3f-914e-458e-866a-963d9c7247a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.853813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77fa3f-914e-458e-866a-963d9c7247a2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.866567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77fa3f-914e-458e-866a-963d9c7247a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:53.875369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-ff77fa3f-914e-458e-866a-963d9c7247a2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 13 16:35:53.880808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 163/330] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:53 2021] GET /identity/v3/roles/reader => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:53.883789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fec1b-f573-4070-9a2d-7f79ac6929a7 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:53.894408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fec1b-f573-4070-9a2d-7f79ac6929a7 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:53.900486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92563bc-8532-42ea-891a-746095ec3dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:53.901239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92563bc-8532-42ea-891a-746095ec3dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.901481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92563bc-8532-42ea-891a-746095ec3dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.901780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92563bc-8532-42ea-891a-746095ec3dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.902577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92563bc-8532-42ea-891a-746095ec3dc3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:53.902879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92563bc-8532-42ea-891a-746095ec3dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:53.904626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92563bc-8532-42ea-891a-746095ec3dc3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:53.920190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 168/331] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:53 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:53.921965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77fa3f-914e-458e-866a-963d9c7247a2 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:53.933464 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77fa3f-914e-458e-866a-963d9c7247a2 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:53.938155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01a432-951f-4013-af00-c7ca09be9eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:53.939036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01a432-951f-4013-af00-c7ca09be9eca admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.939340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01a432-951f-4013-af00-c7ca09be9eca admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.939613 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01a432-951f-4013-af00-c7ca09be9eca admin admin] PATH_INFO: `/v3/users/044155a56b3a4b2385e9689f02f02d90` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.940891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01a432-951f-4013-af00-c7ca09be9eca admin admin] RBAC: Authorizing `identity:get_user(user_id=044155a56b3a4b2385e9689f02f02d90)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:53.943055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01a432-951f-4013-af00-c7ca09be9eca admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:53.945000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 164/332] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:53 2021] GET /identity/v3/users/044155a56b3a4b2385e9689f02f02d90 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:53.951241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92563bc-8532-42ea-891a-746095ec3dc3 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:53.961726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92563bc-8532-42ea-891a-746095ec3dc3 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:53.966513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525df18-7348-4885-b590-7759a88c25e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:53.967423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525df18-7348-4885-b590-7759a88c25e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:53.967700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525df18-7348-4885-b590-7759a88c25e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:53.967973 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525df18-7348-4885-b590-7759a88c25e7 admin admin] PATH_INFO: `/v3/system/users/044155a56b3a4b2385e9689f02f02d90/roles/59ca0f318c444b35add02b8d1f75c421` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:53.969570 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525df18-7348-4885-b590-7759a88c25e7 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=044155a56b3a4b2385e9689f02f02d90, role_id=59ca0f318c444b35add02b8d1f75c421)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:53.970621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-a525df18-7348-4885-b590-7759a88c25e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:53.970621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:35:53.970621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:35:53.971546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525df18-7348-4885-b590-7759a88c25e7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:53.983202 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 169/333] 10.222.0.62 () {58 vars in 1355 bytes} [Mon Dec 13 16:35:53 2021] PUT /identity/v3/system/users/044155a56b3a4b2385e9689f02f02d90/roles/59ca0f318c444b35add02b8d1f75c421 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:35:56.780052 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e1ddf-0729-4937-85d5-fdfa87841e2a None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:56.780672 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e1ddf-0729-4937-85d5-fdfa87841e2a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:56.780672 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e1ddf-0729-4937-85d5-fdfa87841e2a None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:56.782629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 165/334] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:56.794582 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5ce8d-c8ba-485c-9b70-8e15c4ae19ca None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:56.795185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5ce8d-c8ba-485c-9b70-8e15c4ae19ca None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:56.795185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5ce8d-c8ba-485c-9b70-8e15c4ae19ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:56.817591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7ce5ce8d-c8ba-485c-9b70-8e15c4ae19ca None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:56.818790 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7ce5ce8d-c8ba-485c-9b70-8e15c4ae19ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:56.826610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 170/335] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:56 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:56.867820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e1ddf-0729-4937-85d5-fdfa87841e2a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:56.881999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e1ddf-0729-4937-85d5-fdfa87841e2a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:56.890524 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9ffa7-12fd-4ee4-af8e-8eb2e0abe4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:56.891671 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9ffa7-12fd-4ee4-af8e-8eb2e0abe4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:56.891944 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9ffa7-12fd-4ee4-af8e-8eb2e0abe4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:56.892208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9ffa7-12fd-4ee4-af8e-8eb2e0abe4b4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:56.905469 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9ffa7-12fd-4ee4-af8e-8eb2e0abe4b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:56.912382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-b6e9ffa7-12fd-4ee4-af8e-8eb2e0abe4b4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:56.913848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 166/336] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:56 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:56.920464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5ce8d-c8ba-485c-9b70-8e15c4ae19ca None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:56.929655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5ce8d-c8ba-485c-9b70-8e15c4ae19ca None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:56.934239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f612a95-423f-4e1c-9af1-55168d210636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:56.934911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f612a95-423f-4e1c-9af1-55168d210636 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:56.935187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f612a95-423f-4e1c-9af1-55168d210636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:56.935459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f612a95-423f-4e1c-9af1-55168d210636 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:56.936231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f612a95-423f-4e1c-9af1-55168d210636 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:56.936531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f612a95-423f-4e1c-9af1-55168d210636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:56.938171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f612a95-423f-4e1c-9af1-55168d210636 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:56.952722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 171/337] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:56 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:56.959171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9ffa7-12fd-4ee4-af8e-8eb2e0abe4b4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:56.969123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9ffa7-12fd-4ee4-af8e-8eb2e0abe4b4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:56.976550 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bf14a-1945-4715-acd2-f0b6145aed85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:56.977251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bf14a-1945-4715-acd2-f0b6145aed85 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:56.977528 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bf14a-1945-4715-acd2-f0b6145aed85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:56.977796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bf14a-1945-4715-acd2-f0b6145aed85 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:56.992828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bf14a-1945-4715-acd2-f0b6145aed85 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:56.994586 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229bf14a-1945-4715-acd2-f0b6145aed85 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.010322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 167/338] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:56 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:57.017711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f612a95-423f-4e1c-9af1-55168d210636 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.027842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f612a95-423f-4e1c-9af1-55168d210636 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.036217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec860ce-e223-4c8f-88b9-90e68ec341be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.037063 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec860ce-e223-4c8f-88b9-90e68ec341be admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.037338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec860ce-e223-4c8f-88b9-90e68ec341be admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.037602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec860ce-e223-4c8f-88b9-90e68ec341be admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.038833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec860ce-e223-4c8f-88b9-90e68ec341be admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.041297 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec860ce-e223-4c8f-88b9-90e68ec341be admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.043902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4820-8263-4cc0-91d2-0c8145b119b2 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.044180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4820-8263-4cc0-91d2-0c8145b119b2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.044445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde4820-8263-4cc0-91d2-0c8145b119b2 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.046340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 168/339] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:57.046880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 172/340] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:57.052996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde4820-8263-4cc0-91d2-0c8145b119b2 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.062173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d62835-b185-49c5-a4c2-7a46f2d8af15 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.062173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d62835-b185-49c5-a4c2-7a46f2d8af15 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.062173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d62835-b185-49c5-a4c2-7a46f2d8af15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.068440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde4820-8263-4cc0-91d2-0c8145b119b2 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.084445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd01695-040f-429b-b16c-fa0bab76c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.085592 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01695-040f-429b-b16c-fa0bab76c746 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.086160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01695-040f-429b-b16c-fa0bab76c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.086588 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01695-040f-429b-b16c-fa0bab76c746 admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.102047 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-48d62835-b185-49c5-a4c2-7a46f2d8af15 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:57.103743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-48d62835-b185-49c5-a4c2-7a46f2d8af15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:57.105161 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd01695-040f-429b-b16c-fa0bab76c746 admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.106359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-7bd01695-040f-429b-b16c-fa0bab76c746 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:57.106359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:35:57.106359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:35:57.107826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd01695-040f-429b-b16c-fa0bab76c746 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.117077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 169/341] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:57.119154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918ad36-1c17-4f4e-a015-025c18ac60e6 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.119915 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918ad36-1c17-4f4e-a015-025c18ac60e6 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.120812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918ad36-1c17-4f4e-a015-025c18ac60e6 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.123191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 170/342] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:57.125757 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918ad36-1c17-4f4e-a015-025c18ac60e6 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.130753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 173/343] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:57.133763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df93361-3172-4461-a371-e8face11a82d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.134602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df93361-3172-4461-a371-e8face11a82d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.135321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df93361-3172-4461-a371-e8face11a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.160295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918ad36-1c17-4f4e-a015-025c18ac60e6 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.170129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263f34b-489e-4204-b9f5-146dd2895c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.170995 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263f34b-489e-4204-b9f5-146dd2895c65 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.171432 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263f34b-489e-4204-b9f5-146dd2895c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.171848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263f34b-489e-4204-b9f5-146dd2895c65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.175106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263f34b-489e-4204-b9f5-146dd2895c65 admin admin] RBAC: Adding query filter params (group.id=57c3d2c89872435da8311a7d4334c54a, role.id=13af8820459545b2b1e4cea1afea8775, scope.project.id=d1488ecfa5b54f44826bde312726eb2b) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:57.175602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263f34b-489e-4204-b9f5-146dd2895c65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.177636 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263f34b-489e-4204-b9f5-146dd2895c65 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.178725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-1df93361-3172-4461-a371-e8face11a82d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:57.182357 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1df93361-3172-4461-a371-e8face11a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:57.188510 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 171/344] 10.222.0.62 () {56 vars in 1397 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/role_assignments?group.id=57c3d2c89872435da8311a7d4334c54a&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=13af8820459545b2b1e4cea1afea8775 => generated 260 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:57.198795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263f34b-489e-4204-b9f5-146dd2895c65 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.200088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 174/345] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:35:57.210322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263f34b-489e-4204-b9f5-146dd2895c65 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.220931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734a06c-3b5a-4b11-8c79-091a2478fae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.222027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734a06c-3b5a-4b11-8c79-091a2478fae0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.222449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734a06c-3b5a-4b11-8c79-091a2478fae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.222867 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734a06c-3b5a-4b11-8c79-091a2478fae0 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.240177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df93361-3172-4461-a371-e8face11a82d None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.241635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734a06c-3b5a-4b11-8c79-091a2478fae0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:57.248890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a734a06c-3b5a-4b11-8c79-091a2478fae0 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Dec 13 16:35:57.250291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 172/346] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/roles/reader => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:35:57.256668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734a06c-3b5a-4b11-8c79-091a2478fae0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.258141 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df93361-3172-4461-a371-e8face11a82d None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.270600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3613a-9bb3-414b-98a0-e05de5895e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.271438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3613a-9bb3-414b-98a0-e05de5895e16 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.271713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3613a-9bb3-414b-98a0-e05de5895e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.271978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3613a-9bb3-414b-98a0-e05de5895e16 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.274912 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734a06c-3b5a-4b11-8c79-091a2478fae0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.290183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b342e88-c01a-4bd3-b6d7-b5829e947bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.291125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342e88-c01a-4bd3-b6d7-b5829e947bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.291546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342e88-c01a-4bd3-b6d7-b5829e947bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.292041 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b342e88-c01a-4bd3-b6d7-b5829e947bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.292942 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3613a-9bb3-414b-98a0-e05de5895e16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:57.293153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b342e88-c01a-4bd3-b6d7-b5829e947bd2 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:57.293618 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b342e88-c01a-4bd3-b6d7-b5829e947bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.295406 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b342e88-c01a-4bd3-b6d7-b5829e947bd2 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.300447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-d8c3613a-9bb3-414b-98a0-e05de5895e16 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:35:57.302052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 175/347] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:35:57.303379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa5fd0-950c-49a0-8caf-e667ea7483f3 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.303660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa5fd0-950c-49a0-8caf-e667ea7483f3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.303930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa5fd0-950c-49a0-8caf-e667ea7483f3 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.308934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 176/348] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:57.309760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa5fd0-950c-49a0-8caf-e667ea7483f3 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.311720 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 173/349] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:57.317792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5c55b-27fd-42df-9364-400ac235dc64 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.318315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5c55b-27fd-42df-9364-400ac235dc64 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.318732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5c55b-27fd-42df-9364-400ac235dc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.344086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d5d5c55b-27fd-42df-9364-400ac235dc64 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:57.345343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d5d5c55b-27fd-42df-9364-400ac235dc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:57.346929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa5fd0-950c-49a0-8caf-e667ea7483f3 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.355825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01141f-377e-4f3e-a88e-36854d96c049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.356512 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01141f-377e-4f3e-a88e-36854d96c049 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.356820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01141f-377e-4f3e-a88e-36854d96c049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.357096 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01141f-377e-4f3e-a88e-36854d96c049 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.357877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01141f-377e-4f3e-a88e-36854d96c049 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:57.358181 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01141f-377e-4f3e-a88e-36854d96c049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.359845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01141f-377e-4f3e-a88e-36854d96c049 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.368228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 174/350] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:57.369194 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5c55b-27fd-42df-9364-400ac235dc64 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.380674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 177/351] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:57.384288 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5c55b-27fd-42df-9364-400ac235dc64 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.386991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01141f-377e-4f3e-a88e-36854d96c049 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.399225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01141f-377e-4f3e-a88e-36854d96c049 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.403546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c95a30-f754-499f-a896-b4a02643ba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.404210 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95a30-f754-499f-a896-b4a02643ba71 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.404487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95a30-f754-499f-a896-b4a02643ba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.407850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c95a30-f754-499f-a896-b4a02643ba71 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.409499 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d130e9-321f-465f-8b99-ccb386ac4bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.410331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d130e9-321f-465f-8b99-ccb386ac4bee admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.410650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d130e9-321f-465f-8b99-ccb386ac4bee admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.410924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d130e9-321f-465f-8b99-ccb386ac4bee admin admin] PATH_INFO: `/v3/users/044155a56b3a4b2385e9689f02f02d90` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.416350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d130e9-321f-465f-8b99-ccb386ac4bee admin admin] RBAC: Authorizing `identity:get_user(user_id=044155a56b3a4b2385e9689f02f02d90)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.416988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c95a30-f754-499f-a896-b4a02643ba71 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.418557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d130e9-321f-465f-8b99-ccb386ac4bee admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.418735 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c95a30-f754-499f-a896-b4a02643ba71 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.420270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 175/352] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/users/044155a56b3a4b2385e9689f02f02d90 => generated 293 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:57.421137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d130e9-321f-465f-8b99-ccb386ac4bee admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.428893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 178/353] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 13 16:35:57.429754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c95a30-f754-499f-a896-b4a02643ba71 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.435960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d130e9-321f-465f-8b99-ccb386ac4bee admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.443735 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c95a30-f754-499f-a896-b4a02643ba71 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.451886 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d57b-aef8-44d7-a1b8-602c082ecf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.452594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d57b-aef8-44d7-a1b8-602c082ecf5a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.452874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d57b-aef8-44d7-a1b8-602c082ecf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.453148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7d57b-aef8-44d7-a1b8-602c082ecf5a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.453308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb64317-3de9-42de-9e87-f18a8273d8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.454009 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7d57b-aef8-44d7-a1b8-602c082ecf5a admin admin] RBAC: Adding query filter params (role.id=59ca0f318c444b35add02b8d1f75c421, user.id=044155a56b3a4b2385e9689f02f02d90, scope.system=all) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:57.454183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb64317-3de9-42de-9e87-f18a8273d8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.454337 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7d57b-aef8-44d7-a1b8-602c082ecf5a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.454477 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb64317-3de9-42de-9e87-f18a8273d8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.454615 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb64317-3de9-42de-9e87-f18a8273d8a6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.456292 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7d57b-aef8-44d7-a1b8-602c082ecf5a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.470179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 179/354] 10.222.0.62 () {56 vars in 1329 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/role_assignments?user.id=044155a56b3a4b2385e9689f02f02d90&scope.system=all&role.id=59ca0f318c444b35add02b8d1f75c421 => generated 510 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:57.471039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d57b-aef8-44d7-a1b8-602c082ecf5a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.481537 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7d57b-aef8-44d7-a1b8-602c082ecf5a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.485859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d34c8-4cfc-42f0-8ef6-f9b43eab88f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.486733 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d34c8-4cfc-42f0-8ef6-f9b43eab88f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.487014 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d34c8-4cfc-42f0-8ef6-f9b43eab88f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.487279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6d34c8-4cfc-42f0-8ef6-f9b43eab88f6 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.488495 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d34c8-4cfc-42f0-8ef6-f9b43eab88f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.491757 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6d34c8-4cfc-42f0-8ef6-f9b43eab88f6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.493763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 180/355] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:57.494001 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb64317-3de9-42de-9e87-f18a8273d8a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:57.499877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d34c8-4cfc-42f0-8ef6-f9b43eab88f6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.501202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-3fb64317-3de9-42de-9e87-f18a8273d8a6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:35:57.502625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 176/356] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:57.508899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb64317-3de9-42de-9e87-f18a8273d8a6 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.510091 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6d34c8-4cfc-42f0-8ef6-f9b43eab88f6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.514612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f6664-bcc4-4b32-81df-c0b0b981e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.515482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f6664-bcc4-4b32-81df-c0b0b981e5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.516118 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f6664-bcc4-4b32-81df-c0b0b981e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.516385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f6664-bcc4-4b32-81df-c0b0b981e5e2 admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.517645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f6664-bcc4-4b32-81df-c0b0b981e5e2 admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.518693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-6e2f6664-bcc4-4b32-81df-c0b0b981e5e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:35:57.518693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:35:57.518693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:35:57.519896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f6664-bcc4-4b32-81df-c0b0b981e5e2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.521942 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 181/357] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:57.526410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb64317-3de9-42de-9e87-f18a8273d8a6 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.528509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f6664-bcc4-4b32-81df-c0b0b981e5e2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.538956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f6664-bcc4-4b32-81df-c0b0b981e5e2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.545264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e6f00-ade1-4c81-b8bf-81d8b66d1a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.545850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e6f00-ade1-4c81-b8bf-81d8b66d1a95 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.546125 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e6f00-ade1-4c81-b8bf-81d8b66d1a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.546397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e6f00-ade1-4c81-b8bf-81d8b66d1a95 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.547251 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e6f00-ade1-4c81-b8bf-81d8b66d1a95 admin admin] RBAC: Adding query filter params (group.id=57c3d2c89872435da8311a7d4334c54a, role.id=aa4c4022e45a4188814d7840a56322eb, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:57.547558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e6f00-ade1-4c81-b8bf-81d8b66d1a95 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.549370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdf50b-0be9-4a5a-8d95-325b20641f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.549733 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e6f00-ade1-4c81-b8bf-81d8b66d1a95 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.550065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf50b-0be9-4a5a-8d95-325b20641f72 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.550358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf50b-0be9-4a5a-8d95-325b20641f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.550635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdf50b-0be9-4a5a-8d95-325b20641f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.551437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdf50b-0be9-4a5a-8d95-325b20641f72 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:57.551738 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdf50b-0be9-4a5a-8d95-325b20641f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.553435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdf50b-0be9-4a5a-8d95-325b20641f72 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.556398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 182/358] 10.222.0.62 () {56 vars in 1397 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/role_assignments?group.id=57c3d2c89872435da8311a7d4334c54a&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=aa4c4022e45a4188814d7840a56322eb => generated 260 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:57.568940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 177/359] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:57.575130 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e6f00-ade1-4c81-b8bf-81d8b66d1a95 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.589254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e6f00-ade1-4c81-b8bf-81d8b66d1a95 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.593913 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec81ee8-8099-4c11-97cf-d83009450b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.594584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81ee8-8099-4c11-97cf-d83009450b7f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.594851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81ee8-8099-4c11-97cf-d83009450b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.595122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81ee8-8099-4c11-97cf-d83009450b7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.608513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec81ee8-8099-4c11-97cf-d83009450b7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.610346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec81ee8-8099-4c11-97cf-d83009450b7f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.625129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 183/360] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:57.631308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdf50b-0be9-4a5a-8d95-325b20641f72 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.646100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdf50b-0be9-4a5a-8d95-325b20641f72 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.653478 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4fc8f-d5ae-4502-b6b5-eb91b06c6b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.654373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4fc8f-d5ae-4502-b6b5-eb91b06c6b90 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.654659 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4fc8f-d5ae-4502-b6b5-eb91b06c6b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.654923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4fc8f-d5ae-4502-b6b5-eb91b06c6b90 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.661708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4fc8f-d5ae-4502-b6b5-eb91b06c6b90 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.664027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4fc8f-d5ae-4502-b6b5-eb91b06c6b90 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.666524 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 178/361] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:57.672563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec81ee8-8099-4c11-97cf-d83009450b7f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.682578 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec81ee8-8099-4c11-97cf-d83009450b7f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.687002 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e8a84-da50-4653-a776-d11b8062cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.687876 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e8a84-da50-4653-a776-d11b8062cc31 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.688152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e8a84-da50-4653-a776-d11b8062cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.688422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e8a84-da50-4653-a776-d11b8062cc31 admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.694148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e8a84-da50-4653-a776-d11b8062cc31 admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.696501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e8a84-da50-4653-a776-d11b8062cc31 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.698289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 184/362] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:57.704462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4fc8f-d5ae-4502-b6b5-eb91b06c6b90 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:57.718276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4fc8f-d5ae-4502-b6b5-eb91b06c6b90 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:57.729235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb526c7-cdc2-45cb-83d1-831f2466c490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:57.729921 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb526c7-cdc2-45cb-83d1-831f2466c490 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:57.730206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb526c7-cdc2-45cb-83d1-831f2466c490 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:57.730476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb526c7-cdc2-45cb-83d1-831f2466c490 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:57.731346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb526c7-cdc2-45cb-83d1-831f2466c490 admin admin] RBAC: Adding query filter params (group.id=57c3d2c89872435da8311a7d4334c54a, role.id=13af8820459545b2b1e4cea1afea8775, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:57.731662 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb526c7-cdc2-45cb-83d1-831f2466c490 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:57.733614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb526c7-cdc2-45cb-83d1-831f2466c490 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:57.745840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 179/363] 10.222.0.62 () {56 vars in 1397 bytes} [Mon Dec 13 16:35:57 2021] GET /identity/v3/role_assignments?group.id=57c3d2c89872435da8311a7d4334c54a&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=13af8820459545b2b1e4cea1afea8775 => generated 260 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:58.422321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba9f18-2fdb-4d49-9b8d-ccb680a8c64b None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.422989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba9f18-2fdb-4d49-9b8d-ccb680a8c64b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.422989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba9f18-2fdb-4d49-9b8d-ccb680a8c64b None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.424654 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 185/364] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:35:58.432422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23bf0-3f9d-4aa8-8c7e-624a01ec2d39 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.432422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23bf0-3f9d-4aa8-8c7e-624a01ec2d39 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.432422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe23bf0-3f9d-4aa8-8c7e-624a01ec2d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.456719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-1fe23bf0-3f9d-4aa8-8c7e-624a01ec2d39 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:58.458247 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1fe23bf0-3f9d-4aa8-8c7e-624a01ec2d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:58.468812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 180/365] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:58.509036 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba9f18-2fdb-4d49-9b8d-ccb680a8c64b None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:58.526364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba9f18-2fdb-4d49-9b8d-ccb680a8c64b None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:58.534638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455e27b-02a8-4b13-975b-815055232c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:58.535428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455e27b-02a8-4b13-975b-815055232c6b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.535701 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455e27b-02a8-4b13-975b-815055232c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.535974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455e27b-02a8-4b13-975b-815055232c6b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.549568 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455e27b-02a8-4b13-975b-815055232c6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:58.556720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-8455e27b-02a8-4b13-975b-815055232c6b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:35:58.558264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 186/366] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:35:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:58.565082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe23bf0-3f9d-4aa8-8c7e-624a01ec2d39 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:58.577003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe23bf0-3f9d-4aa8-8c7e-624a01ec2d39 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:58.585315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320adf8-8777-436d-be40-62d6f8fd8c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:58.586701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320adf8-8777-436d-be40-62d6f8fd8c5a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.587270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320adf8-8777-436d-be40-62d6f8fd8c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.587772 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320adf8-8777-436d-be40-62d6f8fd8c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.588776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320adf8-8777-436d-be40-62d6f8fd8c5a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:58.589284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320adf8-8777-436d-be40-62d6f8fd8c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:58.591156 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320adf8-8777-436d-be40-62d6f8fd8c5a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:58.605116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 181/367] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:35:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:58.611404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455e27b-02a8-4b13-975b-815055232c6b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:58.625756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455e27b-02a8-4b13-975b-815055232c6b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:58.632378 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19388a66-7f78-423c-9f60-7a297f8e8cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:58.633143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19388a66-7f78-423c-9f60-7a297f8e8cdb admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.633794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19388a66-7f78-423c-9f60-7a297f8e8cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.633794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19388a66-7f78-423c-9f60-7a297f8e8cdb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.648400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19388a66-7f78-423c-9f60-7a297f8e8cdb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:58.650419 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19388a66-7f78-423c-9f60-7a297f8e8cdb admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:58.662651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 187/368] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:58.669447 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320adf8-8777-436d-be40-62d6f8fd8c5a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:58.681787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320adf8-8777-436d-be40-62d6f8fd8c5a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:58.692771 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393a9d1-1f7b-4cb8-9bd8-056e23629b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:58.693941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393a9d1-1f7b-4cb8-9bd8-056e23629b4b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.694444 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393a9d1-1f7b-4cb8-9bd8-056e23629b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.694905 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393a9d1-1f7b-4cb8-9bd8-056e23629b4b admin admin] PATH_INFO: `/v3/projects/3ad2f264c1784427a00af5662d2bd264` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.701336 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393a9d1-1f7b-4cb8-9bd8-056e23629b4b admin admin] RBAC: Authorizing `identity:get_project(project_id=3ad2f264c1784427a00af5662d2bd264)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:58.703385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393a9d1-1f7b-4cb8-9bd8-056e23629b4b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:58.705576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 182/369] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:58 2021] GET /identity/v3/projects/3ad2f264c1784427a00af5662d2bd264 => generated 344 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:58.707083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aef6e7-082b-4b14-a59d-a9ca5353f1c0 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.707370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aef6e7-082b-4b14-a59d-a9ca5353f1c0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.707698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aef6e7-082b-4b14-a59d-a9ca5353f1c0 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.709711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 188/370] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:35:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:35:58.713246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393a9d1-1f7b-4cb8-9bd8-056e23629b4b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:58.725077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393a9d1-1f7b-4cb8-9bd8-056e23629b4b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:58.728135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb857-971a-4c4c-84a6-3c037025c12c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.728417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb857-971a-4c4c-84a6-3c037025c12c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.728732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdb857-971a-4c4c-84a6-3c037025c12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.734791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed4f3e-21af-4268-8580-05248caa89a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:58.735938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed4f3e-21af-4268-8580-05248caa89a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.736408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed4f3e-21af-4268-8580-05248caa89a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.736898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed4f3e-21af-4268-8580-05248caa89a6 admin admin] PATH_INFO: `/v3/groups/f86d499f05a64a25bdb30637003d7b53` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.749294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed4f3e-21af-4268-8580-05248caa89a6 admin admin] RBAC: Authorizing `identity:get_group(group_id=f86d499f05a64a25bdb30637003d7b53)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:58.751049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9bcdb857-971a-4c4c-84a6-3c037025c12c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:35:58.751418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed4f3e-21af-4268-8580-05248caa89a6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:58.752682 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9bcdb857-971a-4c4c-84a6-3c037025c12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:35:58.753461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 183/371] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:35:58 2021] GET /identity/v3/groups/f86d499f05a64a25bdb30637003d7b53 => generated 229 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:58.759962 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed4f3e-21af-4268-8580-05248caa89a6 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:58.761819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 189/372] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:35:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:35:58.773996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed4f3e-21af-4268-8580-05248caa89a6 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:58.784545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053bf0-0edb-412e-86e0-d864bd20d665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:58.785233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053bf0-0edb-412e-86e0-d864bd20d665 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.785515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053bf0-0edb-412e-86e0-d864bd20d665 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.785792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b053bf0-0edb-412e-86e0-d864bd20d665 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.786647 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b053bf0-0edb-412e-86e0-d864bd20d665 admin admin] RBAC: Adding query filter params (group.id=f86d499f05a64a25bdb30637003d7b53, role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=3ad2f264c1784427a00af5662d2bd264) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:58.786958 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b053bf0-0edb-412e-86e0-d864bd20d665 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:58.788817 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b053bf0-0edb-412e-86e0-d864bd20d665 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:58.790240 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdb857-971a-4c4c-84a6-3c037025c12c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:58.800599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 184/373] 10.222.0.62 () {56 vars in 1397 bytes} [Mon Dec 13 16:35:58 2021] GET /identity/v3/role_assignments?group.id=f86d499f05a64a25bdb30637003d7b53&scope.project.id=3ad2f264c1784427a00af5662d2bd264&role.id=f3311ba27a464113b884aa5a1144945d => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:35:58.804779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdb857-971a-4c4c-84a6-3c037025c12c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:58.811261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aba1a-c12d-4c3a-afcd-8c6b7c5340e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:58.812417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aba1a-c12d-4c3a-afcd-8c6b7c5340e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.812932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aba1a-c12d-4c3a-afcd-8c6b7c5340e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.813411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aba1a-c12d-4c3a-afcd-8c6b7c5340e7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.829359 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6aba1a-c12d-4c3a-afcd-8c6b7c5340e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:35:58.837522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-be6aba1a-c12d-4c3a-afcd-8c6b7c5340e7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:35:58.839368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 190/374] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:35:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:35:58.845479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053bf0-0edb-412e-86e0-d864bd20d665 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:58.863316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b053bf0-0edb-412e-86e0-d864bd20d665 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:58.867952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b8c34-15f7-4b01-b3b9-29c55cde5705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:58.868669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8c34-15f7-4b01-b3b9-29c55cde5705 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.868952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8c34-15f7-4b01-b3b9-29c55cde5705 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.869221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b8c34-15f7-4b01-b3b9-29c55cde5705 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.869998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b8c34-15f7-4b01-b3b9-29c55cde5705 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:58.870299 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b8c34-15f7-4b01-b3b9-29c55cde5705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:58.871928 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b8c34-15f7-4b01-b3b9-29c55cde5705 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:58.891726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 185/375] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:35:58 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:58.897736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aba1a-c12d-4c3a-afcd-8c6b7c5340e7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:58.911406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6aba1a-c12d-4c3a-afcd-8c6b7c5340e7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:58.918204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e346ba-2cfa-43fe-b1a3-24c23ea3ca2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:58.919289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e346ba-2cfa-43fe-b1a3-24c23ea3ca2d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.919762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e346ba-2cfa-43fe-b1a3-24c23ea3ca2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.920275 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e346ba-2cfa-43fe-b1a3-24c23ea3ca2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.930304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e346ba-2cfa-43fe-b1a3-24c23ea3ca2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:58.932526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e346ba-2cfa-43fe-b1a3-24c23ea3ca2d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:58.945148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 191/376] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:35:58 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:35:58.953941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b8c34-15f7-4b01-b3b9-29c55cde5705 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:58.967343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b8c34-15f7-4b01-b3b9-29c55cde5705 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:58.971665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043e08b-0b61-4f9f-822d-f698ce218bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:58.972529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e08b-0b61-4f9f-822d-f698ce218bec admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:58.972825 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e08b-0b61-4f9f-822d-f698ce218bec admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:58.973089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043e08b-0b61-4f9f-822d-f698ce218bec admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:58.974275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043e08b-0b61-4f9f-822d-f698ce218bec admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:58.976317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043e08b-0b61-4f9f-822d-f698ce218bec admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:58.982612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 186/377] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:35:58 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:58.988633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e346ba-2cfa-43fe-b1a3-24c23ea3ca2d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:59.000210 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e346ba-2cfa-43fe-b1a3-24c23ea3ca2d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:59.008367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52022113-b09d-4c9f-9be5-ac0ff5194ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:59.009817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52022113-b09d-4c9f-9be5-ac0ff5194ead admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:59.010343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52022113-b09d-4c9f-9be5-ac0ff5194ead admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:59.010877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52022113-b09d-4c9f-9be5-ac0ff5194ead admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:59.013608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52022113-b09d-4c9f-9be5-ac0ff5194ead admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:59.016178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52022113-b09d-4c9f-9be5-ac0ff5194ead admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:59.018544 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 192/378] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:35:58 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:35:59.024629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043e08b-0b61-4f9f-822d-f698ce218bec admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:35:59.038646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043e08b-0b61-4f9f-822d-f698ce218bec admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:35:59.043261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a46359-8dc4-4a8e-8c78-2c62ce91b9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:35:59.043922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a46359-8dc4-4a8e-8c78-2c62ce91b9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:35:59.044199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a46359-8dc4-4a8e-8c78-2c62ce91b9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:35:59.044470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a46359-8dc4-4a8e-8c78-2c62ce91b9e4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:35:59.045350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a46359-8dc4-4a8e-8c78-2c62ce91b9e4 admin admin] RBAC: Adding query filter params (group.id=57c3d2c89872435da8311a7d4334c54a, role.id=aa4c4022e45a4188814d7840a56322eb, scope.project.id=d1488ecfa5b54f44826bde312726eb2b) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:35:59.045658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a46359-8dc4-4a8e-8c78-2c62ce91b9e4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:35:59.047498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a46359-8dc4-4a8e-8c78-2c62ce91b9e4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:35:59.064163 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 187/379] 10.222.0.62 () {56 vars in 1397 bytes} [Mon Dec 13 16:35:59 2021] GET /identity/v3/role_assignments?group.id=57c3d2c89872435da8311a7d4334c54a&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=aa4c4022e45a4188814d7840a56322eb => generated 260 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:00.474081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb964f5-e566-4c2f-8b93-50af428d5007 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.474606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb964f5-e566-4c2f-8b93-50af428d5007 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.474606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb964f5-e566-4c2f-8b93-50af428d5007 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:00.476646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 193/380] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:00.484088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03792bf0-2fea-44d2-9de2-87f8f263ce2c None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.484983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03792bf0-2fea-44d2-9de2-87f8f263ce2c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.485454 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03792bf0-2fea-44d2-9de2-87f8f263ce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:00.509208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-03792bf0-2fea-44d2-9de2-87f8f263ce2c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:00.510399 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-03792bf0-2fea-44d2-9de2-87f8f263ce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:00.521378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 188/381] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:36:00.549702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb964f5-e566-4c2f-8b93-50af428d5007 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:00.561915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb964f5-e566-4c2f-8b93-50af428d5007 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:00.572035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f865f-4e53-4f69-a857-6b799aa178b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:00.572839 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f865f-4e53-4f69-a857-6b799aa178b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.573120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f865f-4e53-4f69-a857-6b799aa178b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.573387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f865f-4e53-4f69-a857-6b799aa178b2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:00.588865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f865f-4e53-4f69-a857-6b799aa178b2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:00.595844 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-b62f865f-4e53-4f69-a857-6b799aa178b2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:36:00.597408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 194/382] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:00.604353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03792bf0-2fea-44d2-9de2-87f8f263ce2c None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:00.613495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03792bf0-2fea-44d2-9de2-87f8f263ce2c None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:00.621071 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f4347-64cc-4ebf-971d-e151b02001a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:00.621748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4347-64cc-4ebf-971d-e151b02001a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.622026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4347-64cc-4ebf-971d-e151b02001a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.622300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4347-64cc-4ebf-971d-e151b02001a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:00.623073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f4347-64cc-4ebf-971d-e151b02001a9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:00.623372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f4347-64cc-4ebf-971d-e151b02001a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:00.625009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f4347-64cc-4ebf-971d-e151b02001a9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:00.633937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 189/383] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:36:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:00.640312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f865f-4e53-4f69-a857-6b799aa178b2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:00.653056 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f865f-4e53-4f69-a857-6b799aa178b2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:00.657542 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd152f9c-f096-4aaf-a255-81020d9decb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:00.658400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd152f9c-f096-4aaf-a255-81020d9decb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.658679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd152f9c-f096-4aaf-a255-81020d9decb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.658948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd152f9c-f096-4aaf-a255-81020d9decb9 admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:00.665017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd152f9c-f096-4aaf-a255-81020d9decb9 admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:00.666963 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd152f9c-f096-4aaf-a255-81020d9decb9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:00.668690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 195/384] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:36:00 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:00.674837 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f4347-64cc-4ebf-971d-e151b02001a9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:00.684965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f4347-64cc-4ebf-971d-e151b02001a9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:00.692520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1085be-c0f4-4ad1-8efc-236b041a3903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:00.693398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1085be-c0f4-4ad1-8efc-236b041a3903 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.693679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1085be-c0f4-4ad1-8efc-236b041a3903 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.693949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1085be-c0f4-4ad1-8efc-236b041a3903 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:00.697311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1085be-c0f4-4ad1-8efc-236b041a3903 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:00.699364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1085be-c0f4-4ad1-8efc-236b041a3903 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:00.701056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 190/385] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:36:00 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:00.707340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd152f9c-f096-4aaf-a255-81020d9decb9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:00.722108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd152f9c-f096-4aaf-a255-81020d9decb9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:00.730905 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a4653-d3c1-4aae-806d-fe0d40ee5729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:00.731816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a4653-d3c1-4aae-806d-fe0d40ee5729 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.732088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a4653-d3c1-4aae-806d-fe0d40ee5729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.732354 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a4653-d3c1-4aae-806d-fe0d40ee5729 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b/groups/57c3d2c89872435da8311a7d4334c54a/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:00.734533 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a4653-d3c1-4aae-806d-fe0d40ee5729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1488ecfa5b54f44826bde312726eb2b, group_id=57c3d2c89872435da8311a7d4334c54a, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:00.737269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732a4653-d3c1-4aae-806d-fe0d40ee5729 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:00.766236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 196/386] 10.222.0.62 () {58 vars in 1463 bytes} [Mon Dec 13 16:36:00 2021] PUT /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b/groups/57c3d2c89872435da8311a7d4334c54a/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:00.816380 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129dd39-786e-4f37-a5d8-e4bb6e1afa76 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.816739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129dd39-786e-4f37-a5d8-e4bb6e1afa76 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.817042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129dd39-786e-4f37-a5d8-e4bb6e1afa76 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:00.819110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 191/387] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:00.825831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139f2a-f182-44e6-9407-9cbbc1543a69 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.826167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139f2a-f182-44e6-9407-9cbbc1543a69 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.826538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139f2a-f182-44e6-9407-9cbbc1543a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:00.847075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c6139f2a-f182-44e6-9407-9cbbc1543a69 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:00.848423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c6139f2a-f182-44e6-9407-9cbbc1543a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:00.918426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 197/388] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:00.955923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129dd39-786e-4f37-a5d8-e4bb6e1afa76 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:00.974608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129dd39-786e-4f37-a5d8-e4bb6e1afa76 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:00.979828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a85a1-3ea0-43f1-af7a-8b990b0241e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:00.980838 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a85a1-3ea0-43f1-af7a-8b990b0241e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.981307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a85a1-3ea0-43f1-af7a-8b990b0241e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.982990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e182d6f-6851-47bf-b7a7-df8efbc77cbf None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.983380 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e182d6f-6851-47bf-b7a7-df8efbc77cbf None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.983895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e182d6f-6851-47bf-b7a7-df8efbc77cbf None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:00.986092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 198/389] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:00.986377 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662a85a1-3ea0-43f1-af7a-8b990b0241e5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:00.994773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267c15a-f8df-4d07-bcbe-121e921f6d50 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:00.995055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267c15a-f8df-4d07-bcbe-121e921f6d50 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:00.995332 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267c15a-f8df-4d07-bcbe-121e921f6d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:01.002199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662a85a1-3ea0-43f1-af7a-8b990b0241e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:01.010196 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-662a85a1-3ea0-43f1-af7a-8b990b0241e5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:36:01.011950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 192/390] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:01.018426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a85a1-3ea0-43f1-af7a-8b990b0241e5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:01.029418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662a85a1-3ea0-43f1-af7a-8b990b0241e5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:01.033615 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a267c15a-f8df-4d07-bcbe-121e921f6d50 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:01.034580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cc64c-b7b4-470b-8f0e-3ecf37396cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:01.034839 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a267c15a-f8df-4d07-bcbe-121e921f6d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:01.035263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cc64c-b7b4-470b-8f0e-3ecf37396cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:01.035541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cc64c-b7b4-470b-8f0e-3ecf37396cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:01.035811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cc64c-b7b4-470b-8f0e-3ecf37396cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:01.036632 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cc64c-b7b4-470b-8f0e-3ecf37396cf5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:01.036942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cc64c-b7b4-470b-8f0e-3ecf37396cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:01.038615 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cc64c-b7b4-470b-8f0e-3ecf37396cf5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:01.055540 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 193/391] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:36:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:01.056563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cc64c-b7b4-470b-8f0e-3ecf37396cf5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:01.057765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 199/392] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:01.079301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cc64c-b7b4-470b-8f0e-3ecf37396cf5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:01.093833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563824a-e1fb-45fc-9c59-8a3d315b2884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:01.094748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563824a-e1fb-45fc-9c59-8a3d315b2884 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:01.094995 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563824a-e1fb-45fc-9c59-8a3d315b2884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:01.095266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563824a-e1fb-45fc-9c59-8a3d315b2884 admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:01.097143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563824a-e1fb-45fc-9c59-8a3d315b2884 admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:01.097686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267c15a-f8df-4d07-bcbe-121e921f6d50 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:01.099063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563824a-e1fb-45fc-9c59-8a3d315b2884 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:01.101011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 194/393] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:36:01 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:01.107493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563824a-e1fb-45fc-9c59-8a3d315b2884 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:01.113426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267c15a-f8df-4d07-bcbe-121e921f6d50 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:01.117892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563824a-e1fb-45fc-9c59-8a3d315b2884 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:01.121115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4be88b-9745-4837-b2f6-488689205af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:01.121933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4be88b-9745-4837-b2f6-488689205af6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:01.122216 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4be88b-9745-4837-b2f6-488689205af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:01.122494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4be88b-9745-4837-b2f6-488689205af6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:01.123013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3459f-4c63-4818-868a-8aa772e44c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:01.124033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3459f-4c63-4818-868a-8aa772e44c03 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:01.124385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3459f-4c63-4818-868a-8aa772e44c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:01.124746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3459f-4c63-4818-868a-8aa772e44c03 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:01.126155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3459f-4c63-4818-868a-8aa772e44c03 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:01.128319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c3459f-4c63-4818-868a-8aa772e44c03 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:01.130127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 195/394] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:36:01 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:01.136854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3459f-4c63-4818-868a-8aa772e44c03 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:01.147956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4be88b-9745-4837-b2f6-488689205af6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:01.148250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3459f-4c63-4818-868a-8aa772e44c03 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:01.154438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-fe4be88b-9745-4837-b2f6-488689205af6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:36:01.154851 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763ab37-3fbf-421f-ae09-00ab4a7d11cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:01.156005 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763ab37-3fbf-421f-ae09-00ab4a7d11cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:01.156491 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763ab37-3fbf-421f-ae09-00ab4a7d11cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:01.157213 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763ab37-3fbf-421f-ae09-00ab4a7d11cd admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/groups/57c3d2c89872435da8311a7d4334c54a/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:01.160593 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 200/395] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:01 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:01.165307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4be88b-9745-4837-b2f6-488689205af6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:01.165916 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763ab37-3fbf-421f-ae09-00ab4a7d11cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c905a70f0f4dc58022cf7d31f2b3c5, group_id=57c3d2c89872435da8311a7d4334c54a, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:01.168899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763ab37-3fbf-421f-ae09-00ab4a7d11cd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:01.189011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4be88b-9745-4837-b2f6-488689205af6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:01.192980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 196/396] 10.222.0.62 () {58 vars in 1463 bytes} [Mon Dec 13 16:36:01 2021] PUT /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/groups/57c3d2c89872435da8311a7d4334c54a/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:01.294761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c9630-d853-49ec-b00d-21aa764d4f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:01.295831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c9630-d853-49ec-b00d-21aa764d4f07 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:01.296350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c9630-d853-49ec-b00d-21aa764d4f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:01.296836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c9630-d853-49ec-b00d-21aa764d4f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:01.297863 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c9630-d853-49ec-b00d-21aa764d4f07 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:01.298408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c9630-d853-49ec-b00d-21aa764d4f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:01.300262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c9630-d853-49ec-b00d-21aa764d4f07 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:01.316134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 201/397] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:01 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:01.328962 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763ab37-3fbf-421f-ae09-00ab4a7d11cd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:01.350487 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763ab37-3fbf-421f-ae09-00ab4a7d11cd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:01.359736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3289-de7f-40fe-9554-ecfc66d5e242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:01.361060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3289-de7f-40fe-9554-ecfc66d5e242 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:01.361575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3289-de7f-40fe-9554-ecfc66d5e242 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:01.362038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee3289-de7f-40fe-9554-ecfc66d5e242 admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:01.369273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee3289-de7f-40fe-9554-ecfc66d5e242 admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:01.371573 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee3289-de7f-40fe-9554-ecfc66d5e242 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:01.374016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 197/398] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:36:01 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:01.380424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c9630-d853-49ec-b00d-21aa764d4f07 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:01.398132 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c9630-d853-49ec-b00d-21aa764d4f07 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:01.408370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a646d-445e-4c60-9e32-6e94d69bc54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:01.412622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a646d-445e-4c60-9e32-6e94d69bc54c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:01.413252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a646d-445e-4c60-9e32-6e94d69bc54c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:01.413788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a646d-445e-4c60-9e32-6e94d69bc54c admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:01.415813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a646d-445e-4c60-9e32-6e94d69bc54c admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:01.418230 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a646d-445e-4c60-9e32-6e94d69bc54c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:01.420637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 202/399] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:36:01 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:01.427093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3289-de7f-40fe-9554-ecfc66d5e242 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:01.438464 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee3289-de7f-40fe-9554-ecfc66d5e242 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:01.446740 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951f615-964c-419b-830c-222f358452e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:01.447982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f615-964c-419b-830c-222f358452e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:01.448456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f615-964c-419b-830c-222f358452e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:01.448989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951f615-964c-419b-830c-222f358452e0 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/groups/57c3d2c89872435da8311a7d4334c54a/roles/aa4c4022e45a4188814d7840a56322eb` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:01.451602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951f615-964c-419b-830c-222f358452e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76c905a70f0f4dc58022cf7d31f2b3c5, group_id=57c3d2c89872435da8311a7d4334c54a, role_id=aa4c4022e45a4188814d7840a56322eb)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:01.454505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951f615-964c-419b-830c-222f358452e0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:01.475299 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 198/400] 10.222.0.62 () {58 vars in 1463 bytes} [Mon Dec 13 16:36:01 2021] PUT /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5/groups/57c3d2c89872435da8311a7d4334c54a/roles/aa4c4022e45a4188814d7840a56322eb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:02.284313 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0ff91-e6fd-49d2-8416-29e5f195862a None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.285408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0ff91-e6fd-49d2-8416-29e5f195862a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.285877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0ff91-e6fd-49d2-8416-29e5f195862a None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.288154 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 203/401] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:02.294203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9477070-7411-42ae-b85d-5e4a5eba5a05 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.295075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9477070-7411-42ae-b85d-5e4a5eba5a05 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.295559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9477070-7411-42ae-b85d-5e4a5eba5a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.325682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d9477070-7411-42ae-b85d-5e4a5eba5a05 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:02.327070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d9477070-7411-42ae-b85d-5e4a5eba5a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:02.412876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 199/402] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:02.452935 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0ff91-e6fd-49d2-8416-29e5f195862a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:02.473386 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0ff91-e6fd-49d2-8416-29e5f195862a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:02.482043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c001ed-3c94-4791-9e31-d1b6fc223682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:02.482859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c001ed-3c94-4791-9e31-d1b6fc223682 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.483134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c001ed-3c94-4791-9e31-d1b6fc223682 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.483401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c001ed-3c94-4791-9e31-d1b6fc223682 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.501489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c001ed-3c94-4791-9e31-d1b6fc223682 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:02.509025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-e0c001ed-3c94-4791-9e31-d1b6fc223682 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:36:02.510276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 204/403] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:02.517227 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9477070-7411-42ae-b85d-5e4a5eba5a05 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:02.528969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9477070-7411-42ae-b85d-5e4a5eba5a05 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:02.535081 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a7f7-f8cf-41dd-9d8a-e074c71a07a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:02.536000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a7f7-f8cf-41dd-9d8a-e074c71a07a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.536471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a7f7-f8cf-41dd-9d8a-e074c71a07a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.536961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a7f7-f8cf-41dd-9d8a-e074c71a07a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.537937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a7f7-f8cf-41dd-9d8a-e074c71a07a9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:02.538432 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a7f7-f8cf-41dd-9d8a-e074c71a07a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:02.540945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a7f7-f8cf-41dd-9d8a-e074c71a07a9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:02.556964 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 200/404] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:02.559736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28ed5e-8ebb-4384-b11a-e015214c51df None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.560018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28ed5e-8ebb-4384-b11a-e015214c51df None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.560291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28ed5e-8ebb-4384-b11a-e015214c51df None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.562348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 205/405] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:02.563523 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a7f7-f8cf-41dd-9d8a-e074c71a07a9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:02.568182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a4a48-f477-407b-97cc-052efeb9923e None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.568486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a4a48-f477-407b-97cc-052efeb9923e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.568772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a4a48-f477-407b-97cc-052efeb9923e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.576775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a7f7-f8cf-41dd-9d8a-e074c71a07a9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:02.590668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234e011-51b3-415d-93c5-95eb003393db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:02.591938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e011-51b3-415d-93c5-95eb003393db admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.592461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e011-51b3-415d-93c5-95eb003393db admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.594147 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234e011-51b3-415d-93c5-95eb003393db admin admin] PATH_INFO: `/v3/groups/f86d499f05a64a25bdb30637003d7b53` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.595565 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234e011-51b3-415d-93c5-95eb003393db admin admin] RBAC: Authorizing `identity:get_group(group_id=f86d499f05a64a25bdb30637003d7b53)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:02.600723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234e011-51b3-415d-93c5-95eb003393db admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:02.605031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 201/406] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:36:02 2021] GET /identity/v3/groups/f86d499f05a64a25bdb30637003d7b53 => generated 229 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:02.608586 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-225a4a48-f477-407b-97cc-052efeb9923e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:02.610042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-225a4a48-f477-407b-97cc-052efeb9923e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:02.611021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234e011-51b3-415d-93c5-95eb003393db admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:02.626177 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234e011-51b3-415d-93c5-95eb003393db admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:02.634277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 206/407] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:02.636209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a90791-b943-441d-8c1c-edef1d25e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:02.639476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90791-b943-441d-8c1c-edef1d25e3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.639962 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90791-b943-441d-8c1c-edef1d25e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.640458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90791-b943-441d-8c1c-edef1d25e3a8 admin admin] PATH_INFO: `/v3/projects/3ad2f264c1784427a00af5662d2bd264` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.642306 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a90791-b943-441d-8c1c-edef1d25e3a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=3ad2f264c1784427a00af5662d2bd264)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:02.644489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a90791-b943-441d-8c1c-edef1d25e3a8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:02.646705 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 202/408] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:36:02 2021] GET /identity/v3/projects/3ad2f264c1784427a00af5662d2bd264 => generated 344 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:02.653774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a4a48-f477-407b-97cc-052efeb9923e None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:02.664820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a4a48-f477-407b-97cc-052efeb9923e None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:02.672008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d77ec-206e-48ea-88c6-b0449fa2d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:02.673228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d77ec-206e-48ea-88c6-b0449fa2d819 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.673672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d77ec-206e-48ea-88c6-b0449fa2d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.674097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d77ec-206e-48ea-88c6-b0449fa2d819 admin admin] PATH_INFO: `/v3/projects/3ad2f264c1784427a00af5662d2bd264/groups/f86d499f05a64a25bdb30637003d7b53/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.676386 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d77ec-206e-48ea-88c6-b0449fa2d819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad2f264c1784427a00af5662d2bd264, group_id=f86d499f05a64a25bdb30637003d7b53, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:02.679538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d77ec-206e-48ea-88c6-b0449fa2d819 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:02.686418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a90791-b943-441d-8c1c-edef1d25e3a8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:02.702240 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a90791-b943-441d-8c1c-edef1d25e3a8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:02.711970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 207/409] 10.222.0.62 () {58 vars in 1463 bytes} [Mon Dec 13 16:36:02 2021] PUT /identity/v3/projects/3ad2f264c1784427a00af5662d2bd264/groups/f86d499f05a64a25bdb30637003d7b53/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:02.785489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e812da5-6102-4653-a673-c202f27448ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:02.786593 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812da5-6102-4653-a673-c202f27448ff admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.787021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812da5-6102-4653-a673-c202f27448ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.787434 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e812da5-6102-4653-a673-c202f27448ff admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.803826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e812da5-6102-4653-a673-c202f27448ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:02.811993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-6e812da5-6102-4653-a673-c202f27448ff admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:36:02.813623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 203/410] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:02.820690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d77ec-206e-48ea-88c6-b0449fa2d819 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:02.832321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d77ec-206e-48ea-88c6-b0449fa2d819 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:02.840739 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebcf84-e891-44ae-8c9e-7b2d2b0c32a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:02.841756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebcf84-e891-44ae-8c9e-7b2d2b0c32a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.842211 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebcf84-e891-44ae-8c9e-7b2d2b0c32a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.842626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbebcf84-e891-44ae-8c9e-7b2d2b0c32a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.843600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebcf84-e891-44ae-8c9e-7b2d2b0c32a2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:02.844050 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebcf84-e891-44ae-8c9e-7b2d2b0c32a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:02.846087 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbebcf84-e891-44ae-8c9e-7b2d2b0c32a2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:02.860954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 208/411] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:02.867588 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e812da5-6102-4653-a673-c202f27448ff admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:02.879847 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e812da5-6102-4653-a673-c202f27448ff admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:02.886991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c6297-4bf8-4b20-aeab-da3ad7c3d150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:02.888184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c6297-4bf8-4b20-aeab-da3ad7c3d150 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.888658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c6297-4bf8-4b20-aeab-da3ad7c3d150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.889070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c6297-4bf8-4b20-aeab-da3ad7c3d150 admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.891008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c6297-4bf8-4b20-aeab-da3ad7c3d150 admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:02.893290 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c6297-4bf8-4b20-aeab-da3ad7c3d150 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:02.895396 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 204/412] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:36:02 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:02.901986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebcf84-e891-44ae-8c9e-7b2d2b0c32a2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:02.914029 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbebcf84-e891-44ae-8c9e-7b2d2b0c32a2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:02.919178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a881c9f-c889-4731-954e-c170aecbafda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:02.920366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881c9f-c889-4731-954e-c170aecbafda admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.920834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881c9f-c889-4731-954e-c170aecbafda admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.921279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a881c9f-c889-4731-954e-c170aecbafda admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.922777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a881c9f-c889-4731-954e-c170aecbafda admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:02.925296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a881c9f-c889-4731-954e-c170aecbafda admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:02.927385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 209/413] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:36:02 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:02.933870 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c6297-4bf8-4b20-aeab-da3ad7c3d150 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:02.944864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c6297-4bf8-4b20-aeab-da3ad7c3d150 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:02.950147 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d41e337-5bc8-48b4-a440-4ab0b0b75c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:02.951283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41e337-5bc8-48b4-a440-4ab0b0b75c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:02.951706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41e337-5bc8-48b4-a440-4ab0b0b75c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:02.952116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d41e337-5bc8-48b4-a440-4ab0b0b75c45 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b/groups/57c3d2c89872435da8311a7d4334c54a/roles/aa4c4022e45a4188814d7840a56322eb` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:02.954648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41e337-5bc8-48b4-a440-4ab0b0b75c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1488ecfa5b54f44826bde312726eb2b, group_id=57c3d2c89872435da8311a7d4334c54a, role_id=aa4c4022e45a4188814d7840a56322eb)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:02.957524 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d41e337-5bc8-48b4-a440-4ab0b0b75c45 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:02.990274 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 205/414] 10.222.0.62 () {58 vars in 1463 bytes} [Mon Dec 13 16:36:02 2021] PUT /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b/groups/57c3d2c89872435da8311a7d4334c54a/roles/aa4c4022e45a4188814d7840a56322eb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:04.119289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe9659-f31b-450c-9133-364fb403eb72 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.119858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe9659-f31b-450c-9133-364fb403eb72 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.120203 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe9659-f31b-450c-9133-364fb403eb72 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.126244 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 210/415] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:04 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:04.132791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d043-9675-4bab-94cc-982f8cd0494d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.133470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d043-9675-4bab-94cc-982f8cd0494d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.133470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d043-9675-4bab-94cc-982f8cd0494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.155350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d2e1d043-9675-4bab-94cc-982f8cd0494d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:04.156974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d2e1d043-9675-4bab-94cc-982f8cd0494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:04.236287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 206/416] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:36:04.254286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b3965-b8da-4e5a-b8ad-3074faeb13e8 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.254620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b3965-b8da-4e5a-b8ad-3074faeb13e8 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.254824 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b3965-b8da-4e5a-b8ad-3074faeb13e8 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.256972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 211/417] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:04.264392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8387852-2b20-4781-a50b-b352e5e16133 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.265012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8387852-2b20-4781-a50b-b352e5e16133 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.265860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8387852-2b20-4781-a50b-b352e5e16133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.275593 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b3965-b8da-4e5a-b8ad-3074faeb13e8 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.286748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d8387852-2b20-4781-a50b-b352e5e16133 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:04.287926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d8387852-2b20-4781-a50b-b352e5e16133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:04.301559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 207/418] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:04.303786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b3965-b8da-4e5a-b8ad-3074faeb13e8 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.320984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b0802-309d-4d06-9eab-a11b26361222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.321812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b0802-309d-4d06-9eab-a11b26361222 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.322090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b0802-309d-4d06-9eab-a11b26361222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.322358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b0802-309d-4d06-9eab-a11b26361222 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.346194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94b0802-309d-4d06-9eab-a11b26361222 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:04.348859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8387852-2b20-4781-a50b-b352e5e16133 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.353636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-c94b0802-309d-4d06-9eab-a11b26361222 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:36:04.355237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 212/419] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:04.358422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8387852-2b20-4781-a50b-b352e5e16133 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.362966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b0802-309d-4d06-9eab-a11b26361222 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.372426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f812f0-20b1-46b2-abc8-c622c0967a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.373487 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f812f0-20b1-46b2-abc8-c622c0967a85 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.373970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f812f0-20b1-46b2-abc8-c622c0967a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.374452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f812f0-20b1-46b2-abc8-c622c0967a85 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.385354 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b0802-309d-4d06-9eab-a11b26361222 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.394044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f812f0-20b1-46b2-abc8-c622c0967a85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:04.395429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb10de-b0c1-4394-ae24-5afe6a37e114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.396326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb10de-b0c1-4394-ae24-5afe6a37e114 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.403775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-e4f812f0-20b1-46b2-abc8-c622c0967a85 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Dec 13 16:36:04.404387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb10de-b0c1-4394-ae24-5afe6a37e114 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.404877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb10de-b0c1-4394-ae24-5afe6a37e114 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.405860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb10de-b0c1-4394-ae24-5afe6a37e114 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:04.406356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb10de-b0c1-4394-ae24-5afe6a37e114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.408200 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb10de-b0c1-4394-ae24-5afe6a37e114 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.411227 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 208/420] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/roles/member => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:04.417765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f812f0-20b1-46b2-abc8-c622c0967a85 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.421465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 213/421] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:04.427118 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb10de-b0c1-4394-ae24-5afe6a37e114 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.434926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f812f0-20b1-46b2-abc8-c622c0967a85 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.438539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb10de-b0c1-4394-ae24-5afe6a37e114 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.443585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8da10-10de-4dde-a63b-1e159182b974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.444234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8da10-10de-4dde-a63b-1e159182b974 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.444516 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8da10-10de-4dde-a63b-1e159182b974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.444816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8da10-10de-4dde-a63b-1e159182b974 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.445089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f73a80-a437-464a-a43d-2835f2411f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.446000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f73a80-a437-464a-a43d-2835f2411f65 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.446470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f73a80-a437-464a-a43d-2835f2411f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.446930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f73a80-a437-464a-a43d-2835f2411f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.447898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f73a80-a437-464a-a43d-2835f2411f65 admin admin] RBAC: Adding query filter params (name=member) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:04.448389 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f73a80-a437-464a-a43d-2835f2411f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.450305 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f73a80-a437-464a-a43d-2835f2411f65 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.455966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8da10-10de-4dde-a63b-1e159182b974 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.457749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8da10-10de-4dde-a63b-1e159182b974 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.467310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 214/422] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 13 16:36:04.468208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 209/423] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:04.473266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8da10-10de-4dde-a63b-1e159182b974 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.474567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f73a80-a437-464a-a43d-2835f2411f65 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.483881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8da10-10de-4dde-a63b-1e159182b974 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.490230 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541496d6-b678-4e25-80c1-da36b8207544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.491097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541496d6-b678-4e25-80c1-da36b8207544 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.491375 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541496d6-b678-4e25-80c1-da36b8207544 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.491646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541496d6-b678-4e25-80c1-da36b8207544 admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.493123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541496d6-b678-4e25-80c1-da36b8207544 admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.495181 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541496d6-b678-4e25-80c1-da36b8207544 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.495453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f73a80-a437-464a-a43d-2835f2411f65 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.497356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 215/424] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:04.502853 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541496d6-b678-4e25-80c1-da36b8207544 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.503082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0075e-7553-4df3-b932-6ae790fc612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.503988 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0075e-7553-4df3-b932-6ae790fc612e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.504414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0075e-7553-4df3-b932-6ae790fc612e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.504841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0075e-7553-4df3-b932-6ae790fc612e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.515045 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541496d6-b678-4e25-80c1-da36b8207544 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.520646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0075e-7553-4df3-b932-6ae790fc612e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.520961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be349a8-0b1f-4db8-b51a-cde0fb018efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.521933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be349a8-0b1f-4db8-b51a-cde0fb018efe admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.522330 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be349a8-0b1f-4db8-b51a-cde0fb018efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.522702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be349a8-0b1f-4db8-b51a-cde0fb018efe admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.523406 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0075e-7553-4df3-b932-6ae790fc612e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.524269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be349a8-0b1f-4db8-b51a-cde0fb018efe admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.526879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be349a8-0b1f-4db8-b51a-cde0fb018efe admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.532595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 216/425] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:04.536452 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be349a8-0b1f-4db8-b51a-cde0fb018efe admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.538876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 210/426] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 13 16:36:04.545080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0075e-7553-4df3-b932-6ae790fc612e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.547005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be349a8-0b1f-4db8-b51a-cde0fb018efe admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.551738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105d2a4-9d92-477b-ab96-56309928ec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.552526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105d2a4-9d92-477b-ab96-56309928ec43 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.552945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105d2a4-9d92-477b-ab96-56309928ec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.553872 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105d2a4-9d92-477b-ab96-56309928ec43 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.554963 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105d2a4-9d92-477b-ab96-56309928ec43 admin admin] RBAC: Adding query filter params (group.id=57c3d2c89872435da8311a7d4334c54a, role.id=13af8820459545b2b1e4cea1afea8775, scope.project.id=d1488ecfa5b54f44826bde312726eb2b) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:04.555542 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105d2a4-9d92-477b-ab96-56309928ec43 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.557688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105d2a4-9d92-477b-ab96-56309928ec43 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.558897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0075e-7553-4df3-b932-6ae790fc612e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.568789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 217/427] 10.222.0.62 () {56 vars in 1397 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/role_assignments?group.id=57c3d2c89872435da8311a7d4334c54a&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=13af8820459545b2b1e4cea1afea8775 => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:04.581557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7261054-ee7e-4bae-b0e0-196511e15904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.582731 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7261054-ee7e-4bae-b0e0-196511e15904 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.583146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7261054-ee7e-4bae-b0e0-196511e15904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.583594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7261054-ee7e-4bae-b0e0-196511e15904 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.585357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7261054-ee7e-4bae-b0e0-196511e15904 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.587843 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7261054-ee7e-4bae-b0e0-196511e15904 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.590283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 211/428] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:04.596282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105d2a4-9d92-477b-ab96-56309928ec43 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.613966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105d2a4-9d92-477b-ab96-56309928ec43 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.625020 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ee56b-a77e-4ca4-84e9-4b155108b76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.625818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee56b-a77e-4ca4-84e9-4b155108b76e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.626100 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee56b-a77e-4ca4-84e9-4b155108b76e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.626378 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ee56b-a77e-4ca4-84e9-4b155108b76e admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.627613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ee56b-a77e-4ca4-84e9-4b155108b76e admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.629626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ee56b-a77e-4ca4-84e9-4b155108b76e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.636689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 218/429] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:04.638123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7261054-ee7e-4bae-b0e0-196511e15904 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.654296 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7261054-ee7e-4bae-b0e0-196511e15904 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.664317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769cec8-1175-4053-b35d-1cca1a0133f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.665580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769cec8-1175-4053-b35d-1cca1a0133f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.666070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769cec8-1175-4053-b35d-1cca1a0133f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.666559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769cec8-1175-4053-b35d-1cca1a0133f6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.667760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769cec8-1175-4053-b35d-1cca1a0133f6 admin admin] RBAC: Adding query filter params (group.id=57c3d2c89872435da8311a7d4334c54a, role.id=13af8820459545b2b1e4cea1afea8775, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:04.668308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769cec8-1175-4053-b35d-1cca1a0133f6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.670488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769cec8-1175-4053-b35d-1cca1a0133f6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.683122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 212/430] 10.222.0.62 () {56 vars in 1397 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/role_assignments?group.id=57c3d2c89872435da8311a7d4334c54a&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=13af8820459545b2b1e4cea1afea8775 => generated 611 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:04.701990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ff71-d11b-42c1-b5c0-66092662199c None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.702349 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ff71-d11b-42c1-b5c0-66092662199c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.702546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06ff71-d11b-42c1-b5c0-66092662199c None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.704633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 219/431] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:04.719142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31010ebe-fb86-4e5e-9570-6ffd73b98355 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.719760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31010ebe-fb86-4e5e-9570-6ffd73b98355 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.720227 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31010ebe-fb86-4e5e-9570-6ffd73b98355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.749951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-31010ebe-fb86-4e5e-9570-6ffd73b98355 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:04.751532 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-31010ebe-fb86-4e5e-9570-6ffd73b98355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:04.760323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 213/432] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:04.810155 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ff71-d11b-42c1-b5c0-66092662199c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.827006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06ff71-d11b-42c1-b5c0-66092662199c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.837110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89a5eb-fa02-415a-93b4-2dc6ed24a8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.837950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89a5eb-fa02-415a-93b4-2dc6ed24a8de admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.838231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89a5eb-fa02-415a-93b4-2dc6ed24a8de admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.838507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89a5eb-fa02-415a-93b4-2dc6ed24a8de admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.855945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89a5eb-fa02-415a-93b4-2dc6ed24a8de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:04.863566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-7c89a5eb-fa02-415a-93b4-2dc6ed24a8de admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:36:04.867697 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 220/433] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:04.872087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31010ebe-fb86-4e5e-9570-6ffd73b98355 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.887034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31010ebe-fb86-4e5e-9570-6ffd73b98355 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.894500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3fdd9-d3a4-4533-88bb-c3c0e666746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.895498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3fdd9-d3a4-4533-88bb-c3c0e666746b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.895946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3fdd9-d3a4-4533-88bb-c3c0e666746b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.896382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3fdd9-d3a4-4533-88bb-c3c0e666746b admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.897371 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3fdd9-d3a4-4533-88bb-c3c0e666746b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:04.897880 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3fdd9-d3a4-4533-88bb-c3c0e666746b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.899975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3fdd9-d3a4-4533-88bb-c3c0e666746b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.913127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 214/434] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:04.919020 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89a5eb-fa02-415a-93b4-2dc6ed24a8de admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.934890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89a5eb-fa02-415a-93b4-2dc6ed24a8de admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.939700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f66a21-f11b-421b-9a2b-ca2597de31df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.940372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f66a21-f11b-421b-9a2b-ca2597de31df admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.940694 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f66a21-f11b-421b-9a2b-ca2597de31df admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.940974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f66a21-f11b-421b-9a2b-ca2597de31df admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.950831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f66a21-f11b-421b-9a2b-ca2597de31df admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.952655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f66a21-f11b-421b-9a2b-ca2597de31df admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.965300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 221/435] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:04.969093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3fdd9-d3a4-4533-88bb-c3c0e666746b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:04.983591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3fdd9-d3a4-4533-88bb-c3c0e666746b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:04.989442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497ebb1-72e3-42f8-92d8-1ec249361a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:04.990569 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ebb1-72e3-42f8-92d8-1ec249361a2e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:04.991026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ebb1-72e3-42f8-92d8-1ec249361a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:04.991471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497ebb1-72e3-42f8-92d8-1ec249361a2e admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:04.993660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497ebb1-72e3-42f8-92d8-1ec249361a2e admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:04.995947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9497ebb1-72e3-42f8-92d8-1ec249361a2e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:04.998207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 215/436] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:36:04 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:05.003963 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f66a21-f11b-421b-9a2b-ca2597de31df admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:05.013786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f66a21-f11b-421b-9a2b-ca2597de31df admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:05.020439 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa50fc0-aa83-4863-8ea0-c4e0b52faa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:05.021512 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa50fc0-aa83-4863-8ea0-c4e0b52faa10 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:05.021990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa50fc0-aa83-4863-8ea0-c4e0b52faa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:05.022416 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa50fc0-aa83-4863-8ea0-c4e0b52faa10 admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:05.024688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa50fc0-aa83-4863-8ea0-c4e0b52faa10 admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:05.026606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa50fc0-aa83-4863-8ea0-c4e0b52faa10 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:05.028399 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 222/437] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:36:05 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:05.035352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497ebb1-72e3-42f8-92d8-1ec249361a2e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:05.045602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497ebb1-72e3-42f8-92d8-1ec249361a2e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:05.050893 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57e4dd-8988-4eff-800d-3a3a9cd64d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:05.051552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57e4dd-8988-4eff-800d-3a3a9cd64d6b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:05.051837 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57e4dd-8988-4eff-800d-3a3a9cd64d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:05.052116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57e4dd-8988-4eff-800d-3a3a9cd64d6b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:05.052995 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57e4dd-8988-4eff-800d-3a3a9cd64d6b admin admin] RBAC: Adding query filter params (group.id=57c3d2c89872435da8311a7d4334c54a, role.id=aa4c4022e45a4188814d7840a56322eb, scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:05.053312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57e4dd-8988-4eff-800d-3a3a9cd64d6b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:05.055200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57e4dd-8988-4eff-800d-3a3a9cd64d6b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:05.062691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 216/438] 10.222.0.62 () {56 vars in 1397 bytes} [Mon Dec 13 16:36:05 2021] GET /identity/v3/role_assignments?group.id=57c3d2c89872435da8311a7d4334c54a&scope.project.id=76c905a70f0f4dc58022cf7d31f2b3c5&role.id=aa4c4022e45a4188814d7840a56322eb => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:05.986196 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff238-9c29-447e-a510-fb0550c460bb None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:05.986737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff238-9c29-447e-a510-fb0550c460bb None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:05.986737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff238-9c29-447e-a510-fb0550c460bb None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:05.988557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 223/439] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:05.994336 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730e4b6-cd6e-420d-b1a9-5ad513e27ff6 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:05.994738 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730e4b6-cd6e-420d-b1a9-5ad513e27ff6 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:05.994872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d730e4b6-cd6e-420d-b1a9-5ad513e27ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:05.999710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f5da2-d1cb-49ff-b8a7-d5caad98e445 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.000122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f5da2-d1cb-49ff-b8a7-d5caad98e445 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.000522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f5da2-d1cb-49ff-b8a7-d5caad98e445 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.003145 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 224/440] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:06.010046 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b532225-a0d0-44e3-820e-dc5d42fd18fc None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.010328 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b532225-a0d0-44e3-820e-dc5d42fd18fc None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.010599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b532225-a0d0-44e3-820e-dc5d42fd18fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.017629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d730e4b6-cd6e-420d-b1a9-5ad513e27ff6 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:06.018810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d730e4b6-cd6e-420d-b1a9-5ad513e27ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:06.027042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 217/441] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:06.028801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-0b532225-a0d0-44e3-820e-dc5d42fd18fc None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:06.029987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0b532225-a0d0-44e3-820e-dc5d42fd18fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:06.037839 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 225/442] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:06 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:06.051062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730e4b6-cd6e-420d-b1a9-5ad513e27ff6 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.060044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d730e4b6-cd6e-420d-b1a9-5ad513e27ff6 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.061198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b532225-a0d0-44e3-820e-dc5d42fd18fc None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.064757 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8117f-df7a-4851-aa9c-3168293513f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.065544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8117f-df7a-4851-aa9c-3168293513f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.065801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8117f-df7a-4851-aa9c-3168293513f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.066068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8117f-df7a-4851-aa9c-3168293513f5 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.070209 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b532225-a0d0-44e3-820e-dc5d42fd18fc None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.075822 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19b5f2-468a-4fde-a18f-02105ddfb592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.076627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b5f2-468a-4fde-a18f-02105ddfb592 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.076725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8117f-df7a-4851-aa9c-3168293513f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:06.076907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b5f2-468a-4fde-a18f-02105ddfb592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.077171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19b5f2-468a-4fde-a18f-02105ddfb592 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.083727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a6b8117f-df7a-4851-aa9c-3168293513f5 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:36:06.084916 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 218/443] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:06.088352 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19b5f2-468a-4fde-a18f-02105ddfb592 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:06.091339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8117f-df7a-4851-aa9c-3168293513f5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.095267 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-1c19b5f2-468a-4fde-a18f-02105ddfb592 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:36:06.096497 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 226/444] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:06.100713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8117f-df7a-4851-aa9c-3168293513f5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.102417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19b5f2-468a-4fde-a18f-02105ddfb592 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.105176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5ee7e-6080-46f9-9e06-53cb6a131cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.105763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5ee7e-6080-46f9-9e06-53cb6a131cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.106073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5ee7e-6080-46f9-9e06-53cb6a131cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.106334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5ee7e-6080-46f9-9e06-53cb6a131cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.107063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5ee7e-6080-46f9-9e06-53cb6a131cb0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:06.107360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5ee7e-6080-46f9-9e06-53cb6a131cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:06.109079 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5ee7e-6080-46f9-9e06-53cb6a131cb0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:06.111471 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19b5f2-468a-4fde-a18f-02105ddfb592 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.115834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963541d-dc6a-4fe6-adbc-3bcc002df0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.116448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963541d-dc6a-4fe6-adbc-3bcc002df0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.116759 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963541d-dc6a-4fe6-adbc-3bcc002df0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.117115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963541d-dc6a-4fe6-adbc-3bcc002df0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.117790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 219/445] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:06.122539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963541d-dc6a-4fe6-adbc-3bcc002df0a6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:06.122539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963541d-dc6a-4fe6-adbc-3bcc002df0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:06.122539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963541d-dc6a-4fe6-adbc-3bcc002df0a6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:06.123456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5ee7e-6080-46f9-9e06-53cb6a131cb0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.128449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 227/446] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:06.133060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5ee7e-6080-46f9-9e06-53cb6a131cb0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.135047 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963541d-dc6a-4fe6-adbc-3bcc002df0a6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.138419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff575d5-0ada-44ae-8c3c-70856b1b3277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.139101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff575d5-0ada-44ae-8c3c-70856b1b3277 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.139389 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff575d5-0ada-44ae-8c3c-70856b1b3277 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.139659 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff575d5-0ada-44ae-8c3c-70856b1b3277 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.146606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963541d-dc6a-4fe6-adbc-3bcc002df0a6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.148890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff575d5-0ada-44ae-8c3c-70856b1b3277 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:06.150668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff575d5-0ada-44ae-8c3c-70856b1b3277 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:06.151698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4709757-e475-4116-b609-284ac040b1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.152331 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4709757-e475-4116-b609-284ac040b1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.152645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4709757-e475-4116-b609-284ac040b1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.152924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4709757-e475-4116-b609-284ac040b1a7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.159366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 220/447] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:06.160752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4709757-e475-4116-b609-284ac040b1a7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:06.162482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4709757-e475-4116-b609-284ac040b1a7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:06.165716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff575d5-0ada-44ae-8c3c-70856b1b3277 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.171498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 228/448] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 13 16:36:06.173990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff575d5-0ada-44ae-8c3c-70856b1b3277 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.177331 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4709757-e475-4116-b609-284ac040b1a7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.178611 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355801aa-15e9-4621-b7f1-986bdddf66ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.179450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355801aa-15e9-4621-b7f1-986bdddf66ea admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.179817 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355801aa-15e9-4621-b7f1-986bdddf66ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.180361 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355801aa-15e9-4621-b7f1-986bdddf66ea admin admin] PATH_INFO: `/v3/projects/d1488ecfa5b54f44826bde312726eb2b` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.181257 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355801aa-15e9-4621-b7f1-986bdddf66ea admin admin] RBAC: Authorizing `identity:get_project(project_id=d1488ecfa5b54f44826bde312726eb2b)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:06.183255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355801aa-15e9-4621-b7f1-986bdddf66ea admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:06.184902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 221/449] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/projects/d1488ecfa5b54f44826bde312726eb2b => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:06.185731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4709757-e475-4116-b609-284ac040b1a7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.190267 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93604db0-eb80-4918-891f-ba44bab532aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.190529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355801aa-15e9-4621-b7f1-986bdddf66ea admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.191080 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93604db0-eb80-4918-891f-ba44bab532aa admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.191356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93604db0-eb80-4918-891f-ba44bab532aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.191618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93604db0-eb80-4918-891f-ba44bab532aa admin admin] PATH_INFO: `/v3/projects/3ad2f264c1784427a00af5662d2bd264` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.192808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93604db0-eb80-4918-891f-ba44bab532aa admin admin] RBAC: Authorizing `identity:get_project(project_id=3ad2f264c1784427a00af5662d2bd264)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:06.194541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93604db0-eb80-4918-891f-ba44bab532aa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:06.196470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 229/450] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/projects/3ad2f264c1784427a00af5662d2bd264 => generated 344 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:06.199656 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355801aa-15e9-4621-b7f1-986bdddf66ea admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.201828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93604db0-eb80-4918-891f-ba44bab532aa admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.203930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c3398-c4ec-42b5-994c-c491e24c5397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.204758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c3398-c4ec-42b5-994c-c491e24c5397 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.205041 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c3398-c4ec-42b5-994c-c491e24c5397 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.205315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c3398-c4ec-42b5-994c-c491e24c5397 admin admin] PATH_INFO: `/v3/groups/57c3d2c89872435da8311a7d4334c54a` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.206470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c3398-c4ec-42b5-994c-c491e24c5397 admin admin] RBAC: Authorizing `identity:get_group(group_id=57c3d2c89872435da8311a7d4334c54a)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:06.208307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c3398-c4ec-42b5-994c-c491e24c5397 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:06.209857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 222/451] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/groups/57c3d2c89872435da8311a7d4334c54a => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:06.210979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93604db0-eb80-4918-891f-ba44bab532aa admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.215139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d701-a86c-4ed9-bb71-ee4af6552df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.215797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c3398-c4ec-42b5-994c-c491e24c5397 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.215923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d701-a86c-4ed9-bb71-ee4af6552df5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.216207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d701-a86c-4ed9-bb71-ee4af6552df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.216478 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4d701-a86c-4ed9-bb71-ee4af6552df5 admin admin] PATH_INFO: `/v3/groups/f86d499f05a64a25bdb30637003d7b53` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.217645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d701-a86c-4ed9-bb71-ee4af6552df5 admin admin] RBAC: Authorizing `identity:get_group(group_id=f86d499f05a64a25bdb30637003d7b53)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:06.219476 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4d701-a86c-4ed9-bb71-ee4af6552df5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:06.221022 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 230/452] 10.222.0.62 () {56 vars in 1201 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/groups/f86d499f05a64a25bdb30637003d7b53 => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:06.224934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c3398-c4ec-42b5-994c-c491e24c5397 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.227134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d701-a86c-4ed9-bb71-ee4af6552df5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:06.229450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508e3db-4d63-4e0f-aa32-96f2b72bc15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.230056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508e3db-4d63-4e0f-aa32-96f2b72bc15c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.230339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508e3db-4d63-4e0f-aa32-96f2b72bc15c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.230613 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508e3db-4d63-4e0f-aa32-96f2b72bc15c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.231431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508e3db-4d63-4e0f-aa32-96f2b72bc15c admin admin] RBAC: Adding query filter params (group.id=57c3d2c89872435da8311a7d4334c54a, role.id=aa4c4022e45a4188814d7840a56322eb, scope.project.id=d1488ecfa5b54f44826bde312726eb2b) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:06.231742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508e3db-4d63-4e0f-aa32-96f2b72bc15c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:06.233570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508e3db-4d63-4e0f-aa32-96f2b72bc15c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:06.235956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4d701-a86c-4ed9-bb71-ee4af6552df5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:06.239304 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 223/453] 10.222.0.62 () {56 vars in 1397 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/role_assignments?group.id=57c3d2c89872435da8311a7d4334c54a&scope.project.id=d1488ecfa5b54f44826bde312726eb2b&role.id=aa4c4022e45a4188814d7840a56322eb => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:06.240193 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fb916-08b0-4a85-89df-29b89b68c77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:06.240823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fb916-08b0-4a85-89df-29b89b68c77e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:06.241100 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fb916-08b0-4a85-89df-29b89b68c77e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:06.241425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fb916-08b0-4a85-89df-29b89b68c77e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:06.242401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fb916-08b0-4a85-89df-29b89b68c77e admin admin] RBAC: Adding query filter params (group.id=f86d499f05a64a25bdb30637003d7b53, role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=3ad2f264c1784427a00af5662d2bd264) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:06.242641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fb916-08b0-4a85-89df-29b89b68c77e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:06.244456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051fb916-08b0-4a85-89df-29b89b68c77e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:06.251221 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 231/454] 10.222.0.62 () {56 vars in 1397 bytes} [Mon Dec 13 16:36:06 2021] GET /identity/v3/role_assignments?group.id=f86d499f05a64a25bdb30637003d7b53&scope.project.id=3ad2f264c1784427a00af5662d2bd264&role.id=f3311ba27a464113b884aa5a1144945d => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:09.320557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea06403-1a71-4e47-b324-08cfdd715511 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.321138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea06403-1a71-4e47-b324-08cfdd715511 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.321421 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea06403-1a71-4e47-b324-08cfdd715511 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.324311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 224/455] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:09.329396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0977-2fbf-4f38-bbc2-d3b80ebe75e2 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.329831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0977-2fbf-4f38-bbc2-d3b80ebe75e2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.330002 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e0977-2fbf-4f38-bbc2-d3b80ebe75e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.361850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-906e0977-2fbf-4f38-bbc2-d3b80ebe75e2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:09.363041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-906e0977-2fbf-4f38-bbc2-d3b80ebe75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:09.378278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 232/456] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:09.415319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a9ca6-7907-4dbd-a56d-96f4ccb20082 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.415943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a9ca6-7907-4dbd-a56d-96f4ccb20082 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.416440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a9ca6-7907-4dbd-a56d-96f4ccb20082 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.417831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e0977-2fbf-4f38-bbc2-d3b80ebe75e2 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.418904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 225/457] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:09.425385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d572-46ff-4c67-b509-3ab0c76a3097 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.425673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d572-46ff-4c67-b509-3ab0c76a3097 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.425950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81d572-46ff-4c67-b509-3ab0c76a3097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.429190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e0977-2fbf-4f38-bbc2-d3b80ebe75e2 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.436496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec64be0-4319-4314-a110-65a35f72dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.437587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec64be0-4319-4314-a110-65a35f72dea1 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.438069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec64be0-4319-4314-a110-65a35f72dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.438546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec64be0-4319-4314-a110-65a35f72dea1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.458616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-cf81d572-46ff-4c67-b509-3ab0c76a3097 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:09.458616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-cf81d572-46ff-4c67-b509-3ab0c76a3097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:09.458851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec64be0-4319-4314-a110-65a35f72dea1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.460445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec64be0-4319-4314-a110-65a35f72dea1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:09.475975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 226/458] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:09.483720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-dec64be0-4319-4314-a110-65a35f72dea1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:09.485258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 233/459] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:09.491229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81d572-46ff-4c67-b509-3ab0c76a3097 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.502211 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec64be0-4319-4314-a110-65a35f72dea1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.507325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81d572-46ff-4c67-b509-3ab0c76a3097 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.518065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b963d1-12a7-4ad0-a077-58aff1e61c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.518736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b963d1-12a7-4ad0-a077-58aff1e61c45 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.519008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b963d1-12a7-4ad0-a077-58aff1e61c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.519274 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b963d1-12a7-4ad0-a077-58aff1e61c45 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.520018 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b963d1-12a7-4ad0-a077-58aff1e61c45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:09.520329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b963d1-12a7-4ad0-a077-58aff1e61c45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.521963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b963d1-12a7-4ad0-a077-58aff1e61c45 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:09.525891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec64be0-4319-4314-a110-65a35f72dea1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.535204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec6a31-7eed-4e98-919a-9607f455725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.536009 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6a31-7eed-4e98-919a-9607f455725d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.536281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6a31-7eed-4e98-919a-9607f455725d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.536549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec6a31-7eed-4e98-919a-9607f455725d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.540175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 227/460] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:09.545848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b963d1-12a7-4ad0-a077-58aff1e61c45 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.548206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec6a31-7eed-4e98-919a-9607f455725d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.550205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec6a31-7eed-4e98-919a-9607f455725d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:09.563091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b963d1-12a7-4ad0-a077-58aff1e61c45 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.567882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-9eec6a31-7eed-4e98-919a-9607f455725d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:09.569476 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 234/461] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:09.577303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b166ecd-0ef4-46a5-addf-445771b09d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.577922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b166ecd-0ef4-46a5-addf-445771b09d10 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.578213 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b166ecd-0ef4-46a5-addf-445771b09d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.578492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b166ecd-0ef4-46a5-addf-445771b09d10 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.579225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b166ecd-0ef4-46a5-addf-445771b09d10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.582972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b166ecd-0ef4-46a5-addf-445771b09d10 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:09.584040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec6a31-7eed-4e98-919a-9607f455725d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.601918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec6a31-7eed-4e98-919a-9607f455725d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.606566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec4d0b-5769-49b3-a09d-e940892491c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.607231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4d0b-5769-49b3-a09d-e940892491c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.607512 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4d0b-5769-49b3-a09d-e940892491c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.607810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec4d0b-5769-49b3-a09d-e940892491c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.608588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec4d0b-5769-49b3-a09d-e940892491c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:09.608863 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec4d0b-5769-49b3-a09d-e940892491c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.609882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-a3ec4d0b-5769-49b3-a09d-e940892491c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:09.609882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:36:09.609882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:36:09.610757 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec4d0b-5769-49b3-a09d-e940892491c0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:09.616488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 228/462] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:36:09 2021] POST /identity/v3/users => generated 246 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:36:09.623172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1332f-e044-4d12-8e57-cdf3cd98519c None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.623738 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1332f-e044-4d12-8e57-cdf3cd98519c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.624225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe1332f-e044-4d12-8e57-cdf3cd98519c None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.632877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 229/463] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:09.635684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 235/464] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:09.642615 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1332f-e044-4d12-8e57-cdf3cd98519c None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.643538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889501c-107d-4ecc-98e0-6cb488907888 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.643831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889501c-107d-4ecc-98e0-6cb488907888 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.644109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889501c-107d-4ecc-98e0-6cb488907888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.676259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7889501c-107d-4ecc-98e0-6cb488907888 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:09.677725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe1332f-e044-4d12-8e57-cdf3cd98519c None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.678868 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7889501c-107d-4ecc-98e0-6cb488907888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:09.685788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6000c-c443-40b8-9782-f2a689b8c104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.686477 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6000c-c443-40b8-9782-f2a689b8c104 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.686757 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6000c-c443-40b8-9782-f2a689b8c104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.687031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6000c-c443-40b8-9782-f2a689b8c104 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.687761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6000c-c443-40b8-9782-f2a689b8c104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.690295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6000c-c443-40b8-9782-f2a689b8c104 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:09.702038 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 236/465] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:36:09.727202 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889501c-107d-4ecc-98e0-6cb488907888 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.730432 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 230/466] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:36:09 2021] POST /identity/v3/users => generated 248 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:09.731785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad771-99d1-4ff7-8586-c7cbb9e2d438 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.732072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad771-99d1-4ff7-8586-c7cbb9e2d438 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.732347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3ad771-99d1-4ff7-8586-c7cbb9e2d438 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.734285 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 231/467] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:09.742089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90e53-a95c-4470-917d-bfbdcd879a34 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.742481 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90e53-a95c-4470-917d-bfbdcd879a34 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.742646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff90e53-a95c-4470-917d-bfbdcd879a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.746956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889501c-107d-4ecc-98e0-6cb488907888 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.762250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac8e14-7d7c-4cf7-abdc-994fc933063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.763058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8e14-7d7c-4cf7-abdc-994fc933063a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.763356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8e14-7d7c-4cf7-abdc-994fc933063a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.763637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac8e14-7d7c-4cf7-abdc-994fc933063a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.764519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-aff90e53-a95c-4470-917d-bfbdcd879a34 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:09.767590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-aff90e53-a95c-4470-917d-bfbdcd879a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:09.783037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 232/468] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:09 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:36:09.790231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac8e14-7d7c-4cf7-abdc-994fc933063a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.792161 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac8e14-7d7c-4cf7-abdc-994fc933063a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:09.806946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff90e53-a95c-4470-917d-bfbdcd879a34 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.817788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff90e53-a95c-4470-917d-bfbdcd879a34 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.819608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-b1ac8e14-7d7c-4cf7-abdc-994fc933063a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:09.826314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 237/469] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:09.829097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac8e14-7d7c-4cf7-abdc-994fc933063a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.830460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adafd5-c889-4e3d-b702-143b2c3289d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.831594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adafd5-c889-4e3d-b702-143b2c3289d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.832088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adafd5-c889-4e3d-b702-143b2c3289d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.832558 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adafd5-c889-4e3d-b702-143b2c3289d3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.845544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adafd5-c889-4e3d-b702-143b2c3289d3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.849106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adafd5-c889-4e3d-b702-143b2c3289d3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:09.851034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac8e14-7d7c-4cf7-abdc-994fc933063a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.871343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff162be-926c-4fa6-b36d-b7bd07f4b4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.871343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff162be-926c-4fa6-b36d-b7bd07f4b4cf admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.871343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff162be-926c-4fa6-b36d-b7bd07f4b4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.871343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff162be-926c-4fa6-b36d-b7bd07f4b4cf admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.871778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff162be-926c-4fa6-b36d-b7bd07f4b4cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:09.871778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff162be-926c-4fa6-b36d-b7bd07f4b4cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.872498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff162be-926c-4fa6-b36d-b7bd07f4b4cf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:09.889422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-c0adafd5-c889-4e3d-b702-143b2c3289d3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:09.893892 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 238/470] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:09.894567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 233/471] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:09.905850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff162be-926c-4fa6-b36d-b7bd07f4b4cf admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.907312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adafd5-c889-4e3d-b702-143b2c3289d3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.924148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff162be-926c-4fa6-b36d-b7bd07f4b4cf admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.926905 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adafd5-c889-4e3d-b702-143b2c3289d3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.933968 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeb413-2ed5-4a4c-9d4d-b7ee35067a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.934981 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4948aa7-d26e-4784-bdb1-d798490bd582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.935674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4948aa7-d26e-4784-bdb1-d798490bd582 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.935946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4948aa7-d26e-4784-bdb1-d798490bd582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.936211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4948aa7-d26e-4784-bdb1-d798490bd582 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.937296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeb413-2ed5-4a4c-9d4d-b7ee35067a98 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.937568 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeb413-2ed5-4a4c-9d4d-b7ee35067a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.937830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeb413-2ed5-4a4c-9d4d-b7ee35067a98 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.938572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeb413-2ed5-4a4c-9d4d-b7ee35067a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.940529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeb413-2ed5-4a4c-9d4d-b7ee35067a98 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:09.941347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4948aa7-d26e-4784-bdb1-d798490bd582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:09.942699 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4948aa7-d26e-4784-bdb1-d798490bd582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.943271 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4948aa7-d26e-4784-bdb1-d798490bd582 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:09.956255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 234/472] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:09.963868 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4948aa7-d26e-4784-bdb1-d798490bd582 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:09.972017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 239/473] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:36:09 2021] POST /identity/v3/users => generated 248 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:09.979623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4948aa7-d26e-4784-bdb1-d798490bd582 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:09.986099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c577ed-5e4d-46e2-a0f9-e3bc127b6c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:09.987435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c577ed-5e4d-46e2-a0f9-e3bc127b6c4d admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:09.987924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c577ed-5e4d-46e2-a0f9-e3bc127b6c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:09.988449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c577ed-5e4d-46e2-a0f9-e3bc127b6c4d admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:09.989459 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c577ed-5e4d-46e2-a0f9-e3bc127b6c4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:09.992366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c577ed-5e4d-46e2-a0f9-e3bc127b6c4d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:10.018370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 235/474] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:36:09 2021] POST /identity/v3/users => generated 249 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:11.000722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbe3d4-a8b9-482f-bcfe-74006d3a9c43 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:11.001770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbe3d4-a8b9-482f-bcfe-74006d3a9c43 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:11.002252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbe3d4-a8b9-482f-bcfe-74006d3a9c43 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:11.004459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 240/475] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:11.010887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4001f-7f40-4641-949a-ae2326d09608 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:11.011712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4001f-7f40-4641-949a-ae2326d09608 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:11.012192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4001f-7f40-4641-949a-ae2326d09608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:11.031097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-ecc4001f-7f40-4641-949a-ae2326d09608 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:11.032598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ecc4001f-7f40-4641-949a-ae2326d09608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:11.044787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 236/476] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:11 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:11.064649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbe3d4-a8b9-482f-bcfe-74006d3a9c43 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:11.077302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbe3d4-a8b9-482f-bcfe-74006d3a9c43 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:11.081834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9ae7e-675e-41d7-95a3-9327d92808b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:11.082761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ae7e-675e-41d7-95a3-9327d92808b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:11.083257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ae7e-675e-41d7-95a3-9327d92808b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:11.083714 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9ae7e-675e-41d7-95a3-9327d92808b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:11.084706 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9ae7e-675e-41d7-95a3-9327d92808b9 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:11.087007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9ae7e-675e-41d7-95a3-9327d92808b9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:11.095489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.sql.core [None req-34a9ae7e-675e-41d7-95a3-9327d92808b9 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Dec 13 16:36:11.095489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Dec 13 16:36:11.095489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [parameters: {'id': '3285f3594a4a4350873146aa3c3d3bfc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Dec 13 16:36:11.095489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86095) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 13 16:36:11.112768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-34a9ae7e-675e-41d7-95a3-9327d92808b9 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Dec 13 16:36:11.114875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 241/477] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:36:11 2021] POST /identity/v3/roles => generated 144 bytes in 51 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:11.121471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4001f-7f40-4641-949a-ae2326d09608 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:11.131358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4001f-7f40-4641-949a-ae2326d09608 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:11.136233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f847867-4519-4173-9fe8-aba382b14046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:11.137430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f847867-4519-4173-9fe8-aba382b14046 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:11.137901 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f847867-4519-4173-9fe8-aba382b14046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:11.138403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f847867-4519-4173-9fe8-aba382b14046 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:11.150967 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f847867-4519-4173-9fe8-aba382b14046 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:11.158779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-6f847867-4519-4173-9fe8-aba382b14046 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Dec 13 16:36:11.160484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 237/478] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:11 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:11.167166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9ae7e-675e-41d7-95a3-9327d92808b9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:11.177550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9ae7e-675e-41d7-95a3-9327d92808b9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:11.182235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890fe74-ced4-435a-9b31-b5e392b299c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:11.183159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890fe74-ced4-435a-9b31-b5e392b299c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:11.183640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890fe74-ced4-435a-9b31-b5e392b299c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:11.184134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890fe74-ced4-435a-9b31-b5e392b299c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:11.185194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890fe74-ced4-435a-9b31-b5e392b299c3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:11.185688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890fe74-ced4-435a-9b31-b5e392b299c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:11.187678 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890fe74-ced4-435a-9b31-b5e392b299c3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:11.197399 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 242/479] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:11 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:12.667453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff9138-0346-4834-916d-9e4a88ca7a50 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:12.667956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff9138-0346-4834-916d-9e4a88ca7a50 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:12.667956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff9138-0346-4834-916d-9e4a88ca7a50 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:12.669969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 238/480] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:12.695778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa473f-50a2-4df1-8cfa-93f843abd10a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:12.696322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa473f-50a2-4df1-8cfa-93f843abd10a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:12.696322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa473f-50a2-4df1-8cfa-93f843abd10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:12.721594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c1fa473f-50a2-4df1-8cfa-93f843abd10a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:12.722795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c1fa473f-50a2-4df1-8cfa-93f843abd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:12.730514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 243/481] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:12.755035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff9138-0346-4834-916d-9e4a88ca7a50 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:12.770609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff9138-0346-4834-916d-9e4a88ca7a50 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:12.781187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c6b40-3321-4e13-a7d7-ffa16c228bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:12.781992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c6b40-3321-4e13-a7d7-ffa16c228bda admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:12.782268 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c6b40-3321-4e13-a7d7-ffa16c228bda admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:12.782531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c6b40-3321-4e13-a7d7-ffa16c228bda admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:12.797492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c6b40-3321-4e13-a7d7-ffa16c228bda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:12.804356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-9c1c6b40-3321-4e13-a7d7-ffa16c228bda admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:12.805606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 239/482] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:12.811889 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa473f-50a2-4df1-8cfa-93f843abd10a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:12.821065 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa473f-50a2-4df1-8cfa-93f843abd10a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:12.828539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266d331-3ed9-44d4-9169-4c3356df29ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:12.829228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266d331-3ed9-44d4-9169-4c3356df29ac admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:12.829506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266d331-3ed9-44d4-9169-4c3356df29ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:12.829778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266d331-3ed9-44d4-9169-4c3356df29ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:12.830541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266d331-3ed9-44d4-9169-4c3356df29ac admin admin] RBAC: Adding query filter params (name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:12.830837 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266d331-3ed9-44d4-9169-4c3356df29ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:12.832435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266d331-3ed9-44d4-9169-4c3356df29ac admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:12.843806 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 244/483] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:12 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:12.849923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c6b40-3321-4e13-a7d7-ffa16c228bda admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:12.865566 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c6b40-3321-4e13-a7d7-ffa16c228bda admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:12.872429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d00d64-290b-4e94-b56c-29807d66013b None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:12.872562 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824a3c5-fd57-4e06-8680-881ca8004ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:12.873121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d00d64-290b-4e94-b56c-29807d66013b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:12.873319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a3c5-fd57-4e06-8680-881ca8004ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:12.873563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a3c5-fd57-4e06-8680-881ca8004ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:12.873831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824a3c5-fd57-4e06-8680-881ca8004ef8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:12.874180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d00d64-290b-4e94-b56c-29807d66013b None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:12.876157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 245/484] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:12 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:12.881916 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3251dd-384a-4261-8ea2-7e06f4bd3676 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:12.882505 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3251dd-384a-4261-8ea2-7e06f4bd3676 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:12.882992 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3251dd-384a-4261-8ea2-7e06f4bd3676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:12.889004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824a3c5-fd57-4e06-8680-881ca8004ef8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:12.891207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824a3c5-fd57-4e06-8680-881ca8004ef8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:12.909049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-bb3251dd-384a-4261-8ea2-7e06f4bd3676 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:12.910637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bb3251dd-384a-4261-8ea2-7e06f4bd3676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:12.921204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-d824a3c5-fd57-4e06-8680-881ca8004ef8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:12.932723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 246/485] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:36:12.933235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 240/486] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:12.935364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3251dd-384a-4261-8ea2-7e06f4bd3676 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:12.949914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3251dd-384a-4261-8ea2-7e06f4bd3676 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:12.958142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f346313b-8462-4791-8b23-d1dd01b5b33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:12.958831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346313b-8462-4791-8b23-d1dd01b5b33e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:12.959110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346313b-8462-4791-8b23-d1dd01b5b33e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:12.959376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f346313b-8462-4791-8b23-d1dd01b5b33e admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:12.960027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37458e8-b305-4595-a536-31f49bdc79e2 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:12.960143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346313b-8462-4791-8b23-d1dd01b5b33e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:12.960421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346313b-8462-4791-8b23-d1dd01b5b33e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:12.960913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37458e8-b305-4595-a536-31f49bdc79e2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:12.961391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37458e8-b305-4595-a536-31f49bdc79e2 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:12.962228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f346313b-8462-4791-8b23-d1dd01b5b33e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:12.963851 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 241/487] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:12.969413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a81f4-566b-48fa-9d3f-f8bd815d0b16 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:12.969960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a81f4-566b-48fa-9d3f-f8bd815d0b16 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:12.970455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a81f4-566b-48fa-9d3f-f8bd815d0b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:12.979034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 247/488] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:12.985758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7343245-b200-4e64-8c26-6e4a8fa5ff10 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:12.986042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7343245-b200-4e64-8c26-6e4a8fa5ff10 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:12.986309 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7343245-b200-4e64-8c26-6e4a8fa5ff10 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:12.988418 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 248/489] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:12.989066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7343245-b200-4e64-8c26-6e4a8fa5ff10 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:12.999825 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d56a81f4-566b-48fa-9d3f-f8bd815d0b16 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:13.001330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d56a81f4-566b-48fa-9d3f-f8bd815d0b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:13.001438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7343245-b200-4e64-8c26-6e4a8fa5ff10 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.005377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a9742-671c-4626-a037-d6f859fd52cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.006142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a9742-671c-4626-a037-d6f859fd52cc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.006423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a9742-671c-4626-a037-d6f859fd52cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.006700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a9742-671c-4626-a037-d6f859fd52cc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.010281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 242/490] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:12 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:36:13.011287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a81f4-566b-48fa-9d3f-f8bd815d0b16 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.020383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a9742-671c-4626-a037-d6f859fd52cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:13.021662 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a81f4-566b-48fa-9d3f-f8bd815d0b16 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.026742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71e7c3-6cc6-44a5-afdd-fcca4be4e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.027932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71e7c3-6cc6-44a5-afdd-fcca4be4e9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.028039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-806a9742-671c-4626-a037-d6f859fd52cc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:13.028525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71e7c3-6cc6-44a5-afdd-fcca4be4e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.029046 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71e7c3-6cc6-44a5-afdd-fcca4be4e9d7 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.029314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 249/491] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:12 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.030786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a5a2-476a-440b-ab47-c15444ad2eb0 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.031067 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a5a2-476a-440b-ab47-c15444ad2eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.031338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79a5a2-476a-440b-ab47-c15444ad2eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.038461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71e7c3-6cc6-44a5-afdd-fcca4be4e9d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.041126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71e7c3-6cc6-44a5-afdd-fcca4be4e9d7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.050757 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7b79a5a2-476a-440b-ab47-c15444ad2eb0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:13.051965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7b79a5a2-476a-440b-ab47-c15444ad2eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:13.056126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-2f71e7c3-6cc6-44a5-afdd-fcca4be4e9d7 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 13 16:36:13.062514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 250/493] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:13.062514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79a5a2-476a-440b-ab47-c15444ad2eb0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.062995 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 243/493] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.063969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71e7c3-6cc6-44a5-afdd-fcca4be4e9d7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.069660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79a5a2-476a-440b-ab47-c15444ad2eb0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.074283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0814a44-5ac1-4664-ae93-a40f89f136fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.074695 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71e7c3-6cc6-44a5-afdd-fcca4be4e9d7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.075082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0814a44-5ac1-4664-ae93-a40f89f136fd admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.075455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0814a44-5ac1-4664-ae93-a40f89f136fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.075791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0814a44-5ac1-4664-ae93-a40f89f136fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.076727 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0814a44-5ac1-4664-ae93-a40f89f136fd admin admin] RBAC: Adding query filter params (name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.077140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0814a44-5ac1-4664-ae93-a40f89f136fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.078841 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0814a44-5ac1-4664-ae93-a40f89f136fd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.080325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae7536-8b35-4602-8ac8-d8b5894b2657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.081343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae7536-8b35-4602-8ac8-d8b5894b2657 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.081724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae7536-8b35-4602-8ac8-d8b5894b2657 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.082091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae7536-8b35-4602-8ac8-d8b5894b2657 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.090288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 251/494] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.091307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0814a44-5ac1-4664-ae93-a40f89f136fd admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.094593 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae7536-8b35-4602-8ac8-d8b5894b2657 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:13.100804 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0814a44-5ac1-4664-ae93-a40f89f136fd admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.102749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-d7ae7536-8b35-4602-8ac8-d8b5894b2657 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:13.104308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 244/495] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.105153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae7536-8b35-4602-8ac8-d8b5894b2657 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.106507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eb42c-62fa-48af-b83a-7578947d3651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.107425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb42c-62fa-48af-b83a-7578947d3651 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.107883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb42c-62fa-48af-b83a-7578947d3651 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.108324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb42c-62fa-48af-b83a-7578947d3651 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.109355 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17eb42c-62fa-48af-b83a-7578947d3651 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.109841 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17eb42c-62fa-48af-b83a-7578947d3651 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.111302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-a17eb42c-62fa-48af-b83a-7578947d3651 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:13.111302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:36:13.111302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:36:13.112777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17eb42c-62fa-48af-b83a-7578947d3651 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.115763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae7536-8b35-4602-8ac8-d8b5894b2657 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.120275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eb420-a6ef-42b0-ac87-aff14e8de72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.121122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb420-a6ef-42b0-ac87-aff14e8de72e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.121405 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb420-a6ef-42b0-ac87-aff14e8de72e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.121727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48eb420-a6ef-42b0-ac87-aff14e8de72e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.133199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48eb420-a6ef-42b0-ac87-aff14e8de72e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:13.140050 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-d48eb420-a6ef-42b0-ac87-aff14e8de72e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:13.146682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 245/496] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.146682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eb420-a6ef-42b0-ac87-aff14e8de72e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.150156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 252/497] 10.222.0.62 () {56 vars in 1158 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.151315 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eb42c-62fa-48af-b83a-7578947d3651 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.159054 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48eb420-a6ef-42b0-ac87-aff14e8de72e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.159921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17eb42c-62fa-48af-b83a-7578947d3651 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.163514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3bd3e-a66c-4872-837d-3681953feca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.164371 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3bd3e-a66c-4872-837d-3681953feca5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.164482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b76e8-a543-40cb-bc0c-0c386045a47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.164797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3bd3e-a66c-4872-837d-3681953feca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.164981 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3bd3e-a66c-4872-837d-3681953feca5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.165135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b76e8-a543-40cb-bc0c-0c386045a47b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.165460 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b76e8-a543-40cb-bc0c-0c386045a47b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.165688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b76e8-a543-40cb-bc0c-0c386045a47b admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.166438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b76e8-a543-40cb-bc0c-0c386045a47b admin admin] RBAC: Adding query filter params (name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.166860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b76e8-a543-40cb-bc0c-0c386045a47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.168358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b76e8-a543-40cb-bc0c-0c386045a47b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.175862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3bd3e-a66c-4872-837d-3681953feca5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.176747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 253/498] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.177681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3bd3e-a66c-4872-837d-3681953feca5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.181600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b76e8-a543-40cb-bc0c-0c386045a47b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.190700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b76e8-a543-40cb-bc0c-0c386045a47b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.194544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-9ea3bd3e-a66c-4872-837d-3681953feca5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:13.194982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b15bf1-541e-406b-9d21-555a951726ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.195652 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b15bf1-541e-406b-9d21-555a951726ea admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.200688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b15bf1-541e-406b-9d21-555a951726ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.200809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 246/499] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.200913 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b15bf1-541e-406b-9d21-555a951726ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.201003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3bd3e-a66c-4872-837d-3681953feca5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.201099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b15bf1-541e-406b-9d21-555a951726ea admin admin] RBAC: Adding query filter params (name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.201099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b15bf1-541e-406b-9d21-555a951726ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.201099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b15bf1-541e-406b-9d21-555a951726ea admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.207490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 254/500] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.208195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b15bf1-541e-406b-9d21-555a951726ea admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.217247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b15bf1-541e-406b-9d21-555a951726ea admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.217442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3bd3e-a66c-4872-837d-3681953feca5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.221507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f55e1-3be7-4924-b660-adb064664eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.222281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f55e1-3be7-4924-b660-adb064664eca admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.222406 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463c226-603f-440e-8ac7-b13722943dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.222565 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f55e1-3be7-4924-b660-adb064664eca admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.222826 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f55e1-3be7-4924-b660-adb064664eca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.223608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c226-603f-440e-8ac7-b13722943dae admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.224065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c226-603f-440e-8ac7-b13722943dae admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.224758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4463c226-603f-440e-8ac7-b13722943dae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.233585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f55e1-3be7-4924-b660-adb064664eca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.234707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463c226-603f-440e-8ac7-b13722943dae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.235430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f55e1-3be7-4924-b660-adb064664eca admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.237091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4463c226-603f-440e-8ac7-b13722943dae admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.247435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 247/501] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:13.248462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463c226-603f-440e-8ac7-b13722943dae admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.251762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-028f55e1-3be7-4924-b660-adb064664eca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:13.253116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 255/502] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.253919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f55e1-3be7-4924-b660-adb064664eca admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.262345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4463c226-603f-440e-8ac7-b13722943dae admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.264009 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f55e1-3be7-4924-b660-adb064664eca admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.266963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c9ab2-181e-40f4-ba01-8b34d9810480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.267609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c9ab2-181e-40f4-ba01-8b34d9810480 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.267884 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c9ab2-181e-40f4-ba01-8b34d9810480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.268149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c9ab2-181e-40f4-ba01-8b34d9810480 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.268906 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c9ab2-181e-40f4-ba01-8b34d9810480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.269204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c9ab2-181e-40f4-ba01-8b34d9810480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.269744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982650f-87da-4996-92b5-78b0ca59da14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.270511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982650f-87da-4996-92b5-78b0ca59da14 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.270788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982650f-87da-4996-92b5-78b0ca59da14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.270877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082c9ab2-181e-40f4-ba01-8b34d9810480 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.271075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982650f-87da-4996-92b5-78b0ca59da14 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.282360 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982650f-87da-4996-92b5-78b0ca59da14 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.283718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 248/503] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.284188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982650f-87da-4996-92b5-78b0ca59da14 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.285042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c9ab2-181e-40f4-ba01-8b34d9810480 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.294419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082c9ab2-181e-40f4-ba01-8b34d9810480 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.299023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fe0ed-078a-4e07-8e17-cfb13b578fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.299941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fe0ed-078a-4e07-8e17-cfb13b578fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.300383 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fe0ed-078a-4e07-8e17-cfb13b578fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.300834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fe0ed-078a-4e07-8e17-cfb13b578fc7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.303751 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-0982650f-87da-4996-92b5-78b0ca59da14 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:13.305011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 256/504] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.305761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982650f-87da-4996-92b5-78b0ca59da14 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.312225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fe0ed-078a-4e07-8e17-cfb13b578fc7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.314251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fe0ed-078a-4e07-8e17-cfb13b578fc7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.323559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982650f-87da-4996-92b5-78b0ca59da14 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.327915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b339bd-004c-4b9f-ace6-9dabe9a2dda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.328590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b339bd-004c-4b9f-ace6-9dabe9a2dda2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.328870 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b339bd-004c-4b9f-ace6-9dabe9a2dda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.329142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b339bd-004c-4b9f-ace6-9dabe9a2dda2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.329871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b339bd-004c-4b9f-ace6-9dabe9a2dda2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.330172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b339bd-004c-4b9f-ace6-9dabe9a2dda2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.331782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b339bd-004c-4b9f-ace6-9dabe9a2dda2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.334920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-2b0fe0ed-078a-4e07-8e17-cfb13b578fc7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:13.336876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 249/505] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.337815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fe0ed-078a-4e07-8e17-cfb13b578fc7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.346956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 257/506] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.347926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fe0ed-078a-4e07-8e17-cfb13b578fc7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.348144 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b339bd-004c-4b9f-ace6-9dabe9a2dda2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.353172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a8f1b-13e6-4427-bdf9-f7774547901a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.354037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a8f1b-13e6-4427-bdf9-f7774547901a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.354380 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a8f1b-13e6-4427-bdf9-f7774547901a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.355073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a8f1b-13e6-4427-bdf9-f7774547901a admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.358132 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b339bd-004c-4b9f-ace6-9dabe9a2dda2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.362141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a8f1b-13e6-4427-bdf9-f7774547901a admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.362376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d158bc-2c17-4e8d-844f-7dc45b4c9f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.363009 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d158bc-2c17-4e8d-844f-7dc45b4c9f1e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.363292 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d158bc-2c17-4e8d-844f-7dc45b4c9f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.363564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d158bc-2c17-4e8d-844f-7dc45b4c9f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.364287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d158bc-2c17-4e8d-844f-7dc45b4c9f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.364603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a8f1b-13e6-4427-bdf9-f7774547901a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.364692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d158bc-2c17-4e8d-844f-7dc45b4c9f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.366205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d158bc-2c17-4e8d-844f-7dc45b4c9f1e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.377401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 258/507] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.382511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d158bc-2c17-4e8d-844f-7dc45b4c9f1e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.383857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a89a8f1b-13e6-4427-bdf9-f7774547901a admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 13 16:36:13.385144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 250/508] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.385946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a8f1b-13e6-4427-bdf9-f7774547901a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.392379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d158bc-2c17-4e8d-844f-7dc45b4c9f1e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.395367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a8f1b-13e6-4427-bdf9-f7774547901a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.397141 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fda179-9b17-4958-b896-42fdf9b68f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.398028 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fda179-9b17-4958-b896-42fdf9b68f56 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.398560 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fda179-9b17-4958-b896-42fdf9b68f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.399036 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fda179-9b17-4958-b896-42fdf9b68f56 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.399795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598e7c5-1ff0-4248-8a74-93ea3dfdab26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.400153 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fda179-9b17-4958-b896-42fdf9b68f56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.400539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598e7c5-1ff0-4248-8a74-93ea3dfdab26 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.400841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598e7c5-1ff0-4248-8a74-93ea3dfdab26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.401023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fda179-9b17-4958-b896-42fdf9b68f56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.401129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598e7c5-1ff0-4248-8a74-93ea3dfdab26 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.402904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fda179-9b17-4958-b896-42fdf9b68f56 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.408529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598e7c5-1ff0-4248-8a74-93ea3dfdab26 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.410545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598e7c5-1ff0-4248-8a74-93ea3dfdab26 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.419918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 259/509] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.419918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fda179-9b17-4958-b896-42fdf9b68f56 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.425263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-8598e7c5-1ff0-4248-8a74-93ea3dfdab26 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 13 16:36:13.426468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 251/510] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/users/neutron => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.428455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598e7c5-1ff0-4248-8a74-93ea3dfdab26 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.429899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fda179-9b17-4958-b896-42fdf9b68f56 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.434237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50ede5-e5bc-429a-bcd9-e11558ca4dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.435434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50ede5-e5bc-429a-bcd9-e11558ca4dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.435434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50ede5-e5bc-429a-bcd9-e11558ca4dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.435628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50ede5-e5bc-429a-bcd9-e11558ca4dc2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.438470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598e7c5-1ff0-4248-8a74-93ea3dfdab26 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.442579 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95968757-9d02-45e2-8fe2-33213a9a253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.443078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50ede5-e5bc-429a-bcd9-e11558ca4dc2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.443187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95968757-9d02-45e2-8fe2-33213a9a253a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.443468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95968757-9d02-45e2-8fe2-33213a9a253a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.443735 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95968757-9d02-45e2-8fe2-33213a9a253a admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.444559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95968757-9d02-45e2-8fe2-33213a9a253a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.444980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95968757-9d02-45e2-8fe2-33213a9a253a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.445190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50ede5-e5bc-429a-bcd9-e11558ca4dc2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.445980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-95968757-9d02-45e2-8fe2-33213a9a253a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:13.445980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:36:13.445980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:36:13.447096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95968757-9d02-45e2-8fe2-33213a9a253a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.458630 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-0f50ede5-e5bc-429a-bcd9-e11558ca4dc2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 13 16:36:13.465125 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 260/511] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.465125 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50ede5-e5bc-429a-bcd9-e11558ca4dc2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.474413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50ede5-e5bc-429a-bcd9-e11558ca4dc2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.479360 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032dc73-bdab-4879-8aa1-a02863fb6c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.480128 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032dc73-bdab-4879-8aa1-a02863fb6c61 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.480513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032dc73-bdab-4879-8aa1-a02863fb6c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.480778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032dc73-bdab-4879-8aa1-a02863fb6c61 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.487671 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032dc73-bdab-4879-8aa1-a02863fb6c61 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.489678 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032dc73-bdab-4879-8aa1-a02863fb6c61 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.495716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 252/512] 10.222.0.62 () {56 vars in 1158 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.495716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95968757-9d02-45e2-8fe2-33213a9a253a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.503182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-4032dc73-bdab-4879-8aa1-a02863fb6c61 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:13.504365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 261/513] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.504729 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95968757-9d02-45e2-8fe2-33213a9a253a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.509340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1ebe3-d1d7-4ec3-8371-6bd21d378f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.509461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032dc73-bdab-4879-8aa1-a02863fb6c61 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.510711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ebe3-d1d7-4ec3-8371-6bd21d378f76 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.510711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ebe3-d1d7-4ec3-8371-6bd21d378f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.510887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1ebe3-d1d7-4ec3-8371-6bd21d378f76 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.511637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1ebe3-d1d7-4ec3-8371-6bd21d378f76 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.511945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1ebe3-d1d7-4ec3-8371-6bd21d378f76 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.513818 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1ebe3-d1d7-4ec3-8371-6bd21d378f76 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.519976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032dc73-bdab-4879-8aa1-a02863fb6c61 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.524561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920e8d1-65bf-46e2-856c-186ee5fd2a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.525214 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920e8d1-65bf-46e2-856c-186ee5fd2a0b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.525528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920e8d1-65bf-46e2-856c-186ee5fd2a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.525800 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920e8d1-65bf-46e2-856c-186ee5fd2a0b admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.526631 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920e8d1-65bf-46e2-856c-186ee5fd2a0b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.526939 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920e8d1-65bf-46e2-856c-186ee5fd2a0b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.528798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920e8d1-65bf-46e2-856c-186ee5fd2a0b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.539720 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 253/514] 10.222.0.62 () {56 vars in 1160 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.539720 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1ebe3-d1d7-4ec3-8371-6bd21d378f76 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.546449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 262/515] 10.222.0.62 () {56 vars in 1154 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.547102 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920e8d1-65bf-46e2-856c-186ee5fd2a0b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.551788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1ebe3-d1d7-4ec3-8371-6bd21d378f76 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.556137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7380-989d-4d32-b484-07873b30e909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.556801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7380-989d-4d32-b484-07873b30e909 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.557487 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7380-989d-4d32-b484-07873b30e909 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.557487 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7380-989d-4d32-b484-07873b30e909 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.560820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920e8d1-65bf-46e2-856c-186ee5fd2a0b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.565152 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7380-989d-4d32-b484-07873b30e909 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.565928 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947e2e8-4757-4f43-af89-fda325804a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.566574 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947e2e8-4757-4f43-af89-fda325804a18 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.566863 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947e2e8-4757-4f43-af89-fda325804a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.566951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7380-989d-4d32-b484-07873b30e909 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.567136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947e2e8-4757-4f43-af89-fda325804a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.567933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947e2e8-4757-4f43-af89-fda325804a18 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.568246 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947e2e8-4757-4f43-af89-fda325804a18 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.569307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-e947e2e8-4757-4f43-af89-fda325804a18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:13.569307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:36:13.569307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:36:13.570605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947e2e8-4757-4f43-af89-fda325804a18 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.575743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 254/516] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:13.576297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7380-989d-4d32-b484-07873b30e909 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.584913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7380-989d-4d32-b484-07873b30e909 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.589515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7505cc-2990-4d8a-b430-51cf44625d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.590466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7505cc-2990-4d8a-b430-51cf44625d67 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.590466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7505cc-2990-4d8a-b430-51cf44625d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.590703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7505cc-2990-4d8a-b430-51cf44625d67 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.593877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 263/517] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.598410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7505cc-2990-4d8a-b430-51cf44625d67 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.599717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947e2e8-4757-4f43-af89-fda325804a18 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.600147 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7505cc-2990-4d8a-b430-51cf44625d67 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.609119 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 255/518] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:13.609709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7505cc-2990-4d8a-b430-51cf44625d67 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.613040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947e2e8-4757-4f43-af89-fda325804a18 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.618126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7505cc-2990-4d8a-b430-51cf44625d67 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.619530 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f71e4-3672-4875-9ad3-d743356401cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.620426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f71e4-3672-4875-9ad3-d743356401cd admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.620927 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f71e4-3672-4875-9ad3-d743356401cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.621398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f71e4-3672-4875-9ad3-d743356401cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.622502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67661db5-902d-4c73-b109-0340222ced00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.623256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661db5-902d-4c73-b109-0340222ced00 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.623535 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661db5-902d-4c73-b109-0340222ced00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.623803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67661db5-902d-4c73-b109-0340222ced00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.631652 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f71e4-3672-4875-9ad3-d743356401cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.633724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f71e4-3672-4875-9ad3-d743356401cd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.634354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67661db5-902d-4c73-b109-0340222ced00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.636166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67661db5-902d-4c73-b109-0340222ced00 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.645339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 264/519] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:13.646561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f71e4-3672-4875-9ad3-d743356401cd admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.654190 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-67661db5-902d-4c73-b109-0340222ced00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:13.655396 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 256/520] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.656212 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67661db5-902d-4c73-b109-0340222ced00 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.657586 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f71e4-3672-4875-9ad3-d743356401cd admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.662891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09c73e-4998-44fa-97db-566432ce9870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.664011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c73e-4998-44fa-97db-566432ce9870 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.664550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c73e-4998-44fa-97db-566432ce9870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.664991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09c73e-4998-44fa-97db-566432ce9870 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.665977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09c73e-4998-44fa-97db-566432ce9870 admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=18f1422ce48e44ab85e6d5e10d1ea898) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.666230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67661db5-902d-4c73-b109-0340222ced00 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.666599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09c73e-4998-44fa-97db-566432ce9870 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.668909 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09c73e-4998-44fa-97db-566432ce9870 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.670565 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea4224-3b87-40ff-983d-6327c4f20160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.671327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea4224-3b87-40ff-983d-6327c4f20160 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.671598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea4224-3b87-40ff-983d-6327c4f20160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.671870 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea4224-3b87-40ff-983d-6327c4f20160 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.676328 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 265/521] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/role_assignments?user.id=18f1422ce48e44ab85e6d5e10d1ea898&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.685509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09c73e-4998-44fa-97db-566432ce9870 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.689908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea4224-3b87-40ff-983d-6327c4f20160 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.691903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09c73e-4998-44fa-97db-566432ce9870 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.692034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea4224-3b87-40ff-983d-6327c4f20160 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.699899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e635d75-2849-4de8-837f-a7e356ba4e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.700894 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e635d75-2849-4de8-837f-a7e356ba4e13 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.701238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e635d75-2849-4de8-837f-a7e356ba4e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.701630 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e635d75-2849-4de8-837f-a7e356ba4e13 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.713599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e635d75-2849-4de8-837f-a7e356ba4e13 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.715594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e635d75-2849-4de8-837f-a7e356ba4e13 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.717989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-46ea4224-3b87-40ff-983d-6327c4f20160 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:13.719760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 257/522] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.720857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea4224-3b87-40ff-983d-6327c4f20160 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.731570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea4224-3b87-40ff-983d-6327c4f20160 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.736503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51696062-1304-48fc-b2da-f7221cc43b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.736990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-1e635d75-2849-4de8-837f-a7e356ba4e13 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:13.737413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51696062-1304-48fc-b2da-f7221cc43b9e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.737763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51696062-1304-48fc-b2da-f7221cc43b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.738104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51696062-1304-48fc-b2da-f7221cc43b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.738984 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51696062-1304-48fc-b2da-f7221cc43b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.739403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51696062-1304-48fc-b2da-f7221cc43b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.741413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51696062-1304-48fc-b2da-f7221cc43b9e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.743745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 266/523] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.744729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e635d75-2849-4de8-837f-a7e356ba4e13 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.754784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e635d75-2849-4de8-837f-a7e356ba4e13 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.755890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 258/524] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.757151 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51696062-1304-48fc-b2da-f7221cc43b9e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.764649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcd1af-82b1-4256-b21b-69765170325d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.765643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcd1af-82b1-4256-b21b-69765170325d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.765926 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcd1af-82b1-4256-b21b-69765170325d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.766201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fcd1af-82b1-4256-b21b-69765170325d admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.766943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcd1af-82b1-4256-b21b-69765170325d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.767252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcd1af-82b1-4256-b21b-69765170325d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.768932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fcd1af-82b1-4256-b21b-69765170325d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.772693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51696062-1304-48fc-b2da-f7221cc43b9e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.778546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2595e8c-5b58-44ad-bb88-38f0be496cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.779645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2595e8c-5b58-44ad-bb88-38f0be496cae admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.780192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2595e8c-5b58-44ad-bb88-38f0be496cae admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.780745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2595e8c-5b58-44ad-bb88-38f0be496cae admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.781727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2595e8c-5b58-44ad-bb88-38f0be496cae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.782279 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2595e8c-5b58-44ad-bb88-38f0be496cae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.783265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 267/525] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.784132 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcd1af-82b1-4256-b21b-69765170325d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.784976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2595e8c-5b58-44ad-bb88-38f0be496cae admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.794602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fcd1af-82b1-4256-b21b-69765170325d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.799143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72493d6-1c7d-4c2c-bf29-e13321a09138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.800043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72493d6-1c7d-4c2c-bf29-e13321a09138 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.800260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72493d6-1c7d-4c2c-bf29-e13321a09138 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.800497 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72493d6-1c7d-4c2c-bf29-e13321a09138 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.800952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 259/526] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.802289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2595e8c-5b58-44ad-bb88-38f0be496cae admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.813707 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72493d6-1c7d-4c2c-bf29-e13321a09138 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.815306 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2595e8c-5b58-44ad-bb88-38f0be496cae admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.815705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72493d6-1c7d-4c2c-bf29-e13321a09138 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.820713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec7e22-98c9-4539-a504-233bb787621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.821874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec7e22-98c9-4539-a504-233bb787621b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.822453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec7e22-98c9-4539-a504-233bb787621b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.822929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec7e22-98c9-4539-a504-233bb787621b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.830344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-c72493d6-1c7d-4c2c-bf29-e13321a09138 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:13.831617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec7e22-98c9-4539-a504-233bb787621b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.834089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec7e22-98c9-4539-a504-233bb787621b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.837091 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 268/527] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.838098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72493d6-1c7d-4c2c-bf29-e13321a09138 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.848330 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72493d6-1c7d-4c2c-bf29-e13321a09138 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.851692 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-ceec7e22-98c9-4539-a504-233bb787621b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:13.853896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8a521-3934-453e-ad1d-d1a6003847fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.854188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 260/528] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.854726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a521-3934-453e-ad1d-d1a6003847fd admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.855002 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a521-3934-453e-ad1d-d1a6003847fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.855277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8a521-3934-453e-ad1d-d1a6003847fd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.856136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec7e22-98c9-4539-a504-233bb787621b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.863098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8a521-3934-453e-ad1d-d1a6003847fd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.865170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8a521-3934-453e-ad1d-d1a6003847fd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.868773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec7e22-98c9-4539-a504-233bb787621b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.874171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f51809-6c89-474e-b729-3d0e233f09e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.875332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51809-6c89-474e-b729-3d0e233f09e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.875842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51809-6c89-474e-b729-3d0e233f09e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.876364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f51809-6c89-474e-b729-3d0e233f09e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.877497 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f51809-6c89-474e-b729-3d0e233f09e7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.878086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f51809-6c89-474e-b729-3d0e233f09e7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.879396 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-36f51809-6c89-474e-b729-3d0e233f09e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:13.879396 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:36:13.879396 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:36:13.879756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-6cb8a521-3934-453e-ad1d-d1a6003847fd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:13.881429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f51809-6c89-474e-b729-3d0e233f09e7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.886640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 269/529] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:13.887693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8a521-3934-453e-ad1d-d1a6003847fd admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.900369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8a521-3934-453e-ad1d-d1a6003847fd admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.904961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53781e6-2bcb-4793-9851-a21b2b71a7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.905633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53781e6-2bcb-4793-9851-a21b2b71a7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.905915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53781e6-2bcb-4793-9851-a21b2b71a7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.906204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53781e6-2bcb-4793-9851-a21b2b71a7c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.906756 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 261/530] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.907003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53781e6-2bcb-4793-9851-a21b2b71a7c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.907296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53781e6-2bcb-4793-9851-a21b2b71a7c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.908315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f51809-6c89-474e-b729-3d0e233f09e7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.914902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53781e6-2bcb-4793-9851-a21b2b71a7c5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.920902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f51809-6c89-474e-b729-3d0e233f09e7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.927420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ad3f-e921-4ebc-8079-a4a1384c48ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.928479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ad3f-e921-4ebc-8079-a4a1384c48ce admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.928788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 270/531] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.929415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ad3f-e921-4ebc-8079-a4a1384c48ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.929887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53781e6-2bcb-4793-9851-a21b2b71a7c5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.930572 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ad3f-e921-4ebc-8079-a4a1384c48ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.931711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ad3f-e921-4ebc-8079-a4a1384c48ce admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.932234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ad3f-e921-4ebc-8079-a4a1384c48ce admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.934479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ad3f-e921-4ebc-8079-a4a1384c48ce admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.940615 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53781e6-2bcb-4793-9851-a21b2b71a7c5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.945688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976d811-1f06-4c48-8633-aeaab43c5b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.946712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976d811-1f06-4c48-8633-aeaab43c5b3c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.947113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976d811-1f06-4c48-8633-aeaab43c5b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.947489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e976d811-1f06-4c48-8633-aeaab43c5b3c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.948536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976d811-1f06-4c48-8633-aeaab43c5b3c admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=20f42eb51a824f69a6f77c5044300da2) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.949016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976d811-1f06-4c48-8633-aeaab43c5b3c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.951695 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 262/532] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.952847 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ad3f-e921-4ebc-8079-a4a1384c48ce admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.957295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e976d811-1f06-4c48-8633-aeaab43c5b3c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.964699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 271/533] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/role_assignments?user.id=20f42eb51a824f69a6f77c5044300da2&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.964951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ad3f-e921-4ebc-8079-a4a1384c48ce admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.965583 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976d811-1f06-4c48-8633-aeaab43c5b3c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:13.970189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1f796-9ea9-485d-9ae4-ec11b46dd6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.971325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f796-9ea9-485d-9ae4-ec11b46dd6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.972503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f796-9ea9-485d-9ae4-ec11b46dd6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.972941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f796-9ea9-485d-9ae4-ec11b46dd6e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.974329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1f796-9ea9-485d-9ae4-ec11b46dd6e5 admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=51f9a10e3d87475e92fb49686f1aa456) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.974852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1f796-9ea9-485d-9ae4-ec11b46dd6e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.976320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e976d811-1f06-4c48-8633-aeaab43c5b3c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:13.977442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1f796-9ea9-485d-9ae4-ec11b46dd6e5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:13.983940 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c1091-fa14-4776-9c25-36d5b34e4911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:13.984840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c1091-fa14-4776-9c25-36d5b34e4911 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:13.985223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c1091-fa14-4776-9c25-36d5b34e4911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:13.985612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c1091-fa14-4776-9c25-36d5b34e4911 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:13.986506 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 263/534] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/role_assignments?user.id=51f9a10e3d87475e92fb49686f1aa456&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:13.986626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c1091-fa14-4776-9c25-36d5b34e4911 admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=dfecc747eb8d431a8d57f4534d259de8) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:13.993420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c1091-fa14-4776-9c25-36d5b34e4911 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:13.995872 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c1091-fa14-4776-9c25-36d5b34e4911 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:14.003298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 272/535] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:13 2021] GET /identity/v3/role_assignments?user.id=dfecc747eb8d431a8d57f4534d259de8&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:14.363362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9255cc0-0e8c-4405-81d1-7a34af009845 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:14.363646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9255cc0-0e8c-4405-81d1-7a34af009845 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:14.363922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9255cc0-0e8c-4405-81d1-7a34af009845 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:14.365924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 264/536] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:14.373060 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e47e77-9c4c-47cf-92f3-d5a58ff1040c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:14.373540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e47e77-9c4c-47cf-92f3-d5a58ff1040c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:14.373960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e47e77-9c4c-47cf-92f3-d5a58ff1040c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:14.401668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-46e47e77-9c4c-47cf-92f3-d5a58ff1040c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:14.403105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-46e47e77-9c4c-47cf-92f3-d5a58ff1040c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:14.411247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 273/537] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:14.453255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9255cc0-0e8c-4405-81d1-7a34af009845 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:14.470449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9255cc0-0e8c-4405-81d1-7a34af009845 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:14.478926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33c132-b701-41cd-b449-15e09b60588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:14.479718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33c132-b701-41cd-b449-15e09b60588f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:14.479994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33c132-b701-41cd-b449-15e09b60588f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:14.480262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33c132-b701-41cd-b449-15e09b60588f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:14.496411 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33c132-b701-41cd-b449-15e09b60588f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:14.498487 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33c132-b701-41cd-b449-15e09b60588f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:14.518040 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-4c33c132-b701-41cd-b449-15e09b60588f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:14.519540 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 265/538] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:14.526612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e47e77-9c4c-47cf-92f3-d5a58ff1040c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:14.535934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e47e77-9c4c-47cf-92f3-d5a58ff1040c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:14.548821 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac97a6-82bb-40cb-8788-74ba613c365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:14.549785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac97a6-82bb-40cb-8788-74ba613c365a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:14.550198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac97a6-82bb-40cb-8788-74ba613c365a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:14.550598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac97a6-82bb-40cb-8788-74ba613c365a admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:14.551471 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac97a6-82bb-40cb-8788-74ba613c365a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:14.551906 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac97a6-82bb-40cb-8788-74ba613c365a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:14.553676 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac97a6-82bb-40cb-8788-74ba613c365a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:14.566819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 274/539] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:14.573228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33c132-b701-41cd-b449-15e09b60588f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:14.585679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33c132-b701-41cd-b449-15e09b60588f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:14.592670 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfe419-7b47-4bb8-bd1d-e9de8593fbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:14.593345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe419-7b47-4bb8-bd1d-e9de8593fbae admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:14.593620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe419-7b47-4bb8-bd1d-e9de8593fbae admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:14.593888 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfe419-7b47-4bb8-bd1d-e9de8593fbae admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:14.594614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfe419-7b47-4bb8-bd1d-e9de8593fbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:14.596534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfe419-7b47-4bb8-bd1d-e9de8593fbae admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:14.627208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 266/540] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:36:14 2021] POST /identity/v3/users => generated 247 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:16.571138 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbf092-cdb4-4ee6-9feb-f057c0cd588b None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:16.572235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbf092-cdb4-4ee6-9feb-f057c0cd588b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:16.572744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbf092-cdb4-4ee6-9feb-f057c0cd588b None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:16.575233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 275/541] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:16.582423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7c09-a588-4e67-a786-6eed7b1173ac None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:16.583390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7c09-a588-4e67-a786-6eed7b1173ac None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:16.583848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc7c09-a588-4e67-a786-6eed7b1173ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:16.603390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-14bc7c09-a588-4e67-a786-6eed7b1173ac None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:16.605000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-14bc7c09-a588-4e67-a786-6eed7b1173ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:16.612864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 267/542] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:16.636860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbf092-cdb4-4ee6-9feb-f057c0cd588b None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:16.649985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbf092-cdb4-4ee6-9feb-f057c0cd588b None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:16.654621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fadc37-99b3-47ff-8c93-de7d5e97a86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:16.655679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fadc37-99b3-47ff-8c93-de7d5e97a86a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:16.656153 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fadc37-99b3-47ff-8c93-de7d5e97a86a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:16.656636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fadc37-99b3-47ff-8c93-de7d5e97a86a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:16.667493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fadc37-99b3-47ff-8c93-de7d5e97a86a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:16.674630 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-b7fadc37-99b3-47ff-8c93-de7d5e97a86a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:16.680660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 276/543] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:16.682906 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc7c09-a588-4e67-a786-6eed7b1173ac None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:16.694841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc7c09-a588-4e67-a786-6eed7b1173ac None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:16.703763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee16304-1814-415a-90e0-da53c76854dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:16.704845 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee16304-1814-415a-90e0-da53c76854dc admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:16.705330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee16304-1814-415a-90e0-da53c76854dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:16.705785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee16304-1814-415a-90e0-da53c76854dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:16.706737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee16304-1814-415a-90e0-da53c76854dc admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:16.707222 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee16304-1814-415a-90e0-da53c76854dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:16.709065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee16304-1814-415a-90e0-da53c76854dc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:16.724149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 268/544] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:16.730599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fadc37-99b3-47ff-8c93-de7d5e97a86a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:16.745964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fadc37-99b3-47ff-8c93-de7d5e97a86a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:16.756506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516f799-10d0-4e5c-aed8-8e9f5c375b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:16.757369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f799-10d0-4e5c-aed8-8e9f5c375b47 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:16.758203 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f799-10d0-4e5c-aed8-8e9f5c375b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:16.758486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516f799-10d0-4e5c-aed8-8e9f5c375b47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:16.778774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516f799-10d0-4e5c-aed8-8e9f5c375b47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:16.780645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516f799-10d0-4e5c-aed8-8e9f5c375b47 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:16.793562 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f141996-963c-477d-8f0d-83fe5891b484 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:16.794175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f141996-963c-477d-8f0d-83fe5891b484 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:16.795109 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f141996-963c-477d-8f0d-83fe5891b484 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:16.797910 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 269/545] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:16.806077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-7516f799-10d0-4e5c-aed8-8e9f5c375b47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:16.806473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b24a1b-5ac2-42e3-9c4d-4e822f40e93b None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:16.806963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b24a1b-5ac2-42e3-9c4d-4e822f40e93b None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:16.807420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b24a1b-5ac2-42e3-9c4d-4e822f40e93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:16.807634 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 277/546] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:16.817572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516f799-10d0-4e5c-aed8-8e9f5c375b47 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:16.833131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516f799-10d0-4e5c-aed8-8e9f5c375b47 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:16.834345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-60b24a1b-5ac2-42e3-9c4d-4e822f40e93b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:16.836903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-60b24a1b-5ac2-42e3-9c4d-4e822f40e93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:16.842161 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1be12-f03b-4772-8dd8-387dbb642825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:16.843834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1be12-f03b-4772-8dd8-387dbb642825 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:16.845260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1be12-f03b-4772-8dd8-387dbb642825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:16.845741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1be12-f03b-4772-8dd8-387dbb642825 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:16.848202 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1be12-f03b-4772-8dd8-387dbb642825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:16.848745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1be12-f03b-4772-8dd8-387dbb642825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:16.851426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1be12-f03b-4772-8dd8-387dbb642825 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:16.853905 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 270/547] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:36:16.866905 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 278/548] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:16.872992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b24a1b-5ac2-42e3-9c4d-4e822f40e93b None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:16.885777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b24a1b-5ac2-42e3-9c4d-4e822f40e93b None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:16.890811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e60118-ead1-46fe-a59f-c6ddd824969e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:16.891872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e60118-ead1-46fe-a59f-c6ddd824969e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:16.892362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e60118-ead1-46fe-a59f-c6ddd824969e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:16.892841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e60118-ead1-46fe-a59f-c6ddd824969e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:16.901094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1be12-f03b-4772-8dd8-387dbb642825 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:16.914766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1be12-f03b-4772-8dd8-387dbb642825 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:16.920808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2a58e-97fb-441a-9a32-4cf66f3cf677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:16.921184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e60118-ead1-46fe-a59f-c6ddd824969e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:16.923776 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2a58e-97fb-441a-9a32-4cf66f3cf677 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:16.924255 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2a58e-97fb-441a-9a32-4cf66f3cf677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:16.924761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2a58e-97fb-441a-9a32-4cf66f3cf677 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:16.925849 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e60118-ead1-46fe-a59f-c6ddd824969e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:16.948615 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2a58e-97fb-441a-9a32-4cf66f3cf677 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:16.954603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-33e60118-ead1-46fe-a59f-c6ddd824969e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 13 16:36:16.959891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-a7c2a58e-97fb-441a-9a32-4cf66f3cf677 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:16.960293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 271/549] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:16 2021] GET /identity/v3/users/glance => generated 84 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:16.966998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e60118-ead1-46fe-a59f-c6ddd824969e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:16.972060 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 279/550] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:16.977284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2a58e-97fb-441a-9a32-4cf66f3cf677 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:16.985509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e60118-ead1-46fe-a59f-c6ddd824969e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:16.992201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2a58e-97fb-441a-9a32-4cf66f3cf677 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:16.995657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcad65e-a1fd-4e3a-a6e8-b620dcfacf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:16.996648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcad65e-a1fd-4e3a-a6e8-b620dcfacf72 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:16.997237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcad65e-a1fd-4e3a-a6e8-b620dcfacf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:16.997876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcad65e-a1fd-4e3a-a6e8-b620dcfacf72 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:16.999043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcad65e-a1fd-4e3a-a6e8-b620dcfacf72 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:16.999613 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcad65e-a1fd-4e3a-a6e8-b620dcfacf72 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.002135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcad65e-a1fd-4e3a-a6e8-b620dcfacf72 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.002443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a53d39-96a7-4d3e-abbd-3843af42837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.003112 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53d39-96a7-4d3e-abbd-3843af42837b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.003393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53d39-96a7-4d3e-abbd-3843af42837b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.003665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a53d39-96a7-4d3e-abbd-3843af42837b admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.004430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53d39-96a7-4d3e-abbd-3843af42837b admin admin] RBAC: Adding query filter params (name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.004782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53d39-96a7-4d3e-abbd-3843af42837b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.007557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a53d39-96a7-4d3e-abbd-3843af42837b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.016782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 280/551] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.018081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4542b5-1dff-4e0a-9cc5-efa983644072 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.018365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4542b5-1dff-4e0a-9cc5-efa983644072 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.018636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4542b5-1dff-4e0a-9cc5-efa983644072 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.020238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 281/552] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:17.024854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795f7cc-3bb7-4c27-b6f0-4d40c5d05a3c None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.025148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795f7cc-3bb7-4c27-b6f0-4d40c5d05a3c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.025563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795f7cc-3bb7-4c27-b6f0-4d40c5d05a3c None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.027242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 282/553] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:17 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:17.027933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795f7cc-3bb7-4c27-b6f0-4d40c5d05a3c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.028073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 272/554] 10.222.0.62 () {56 vars in 1158 bytes} [Mon Dec 13 16:36:16 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.029734 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb16e8-7234-46f7-9cbc-9e4809fe92a5 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.030170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb16e8-7234-46f7-9cbc-9e4809fe92a5 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.030571 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb16e8-7234-46f7-9cbc-9e4809fe92a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.044716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795f7cc-3bb7-4c27-b6f0-4d40c5d05a3c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.048626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-9afb16e8-7234-46f7-9cbc-9e4809fe92a5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:17.048915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c3060-ea4b-4467-b616-79954176f685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.049682 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c3060-ea4b-4467-b616-79954176f685 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.049958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c3060-ea4b-4467-b616-79954176f685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.050232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c3060-ea4b-4467-b616-79954176f685 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.050682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9afb16e8-7234-46f7-9cbc-9e4809fe92a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:17.058657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 273/555] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:17.060083 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6ed3f-eda5-4a30-a8f1-73c635a7c2ef None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.060360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6ed3f-eda5-4a30-a8f1-73c635a7c2ef None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.061221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6ed3f-eda5-4a30-a8f1-73c635a7c2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.063368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c3060-ea4b-4467-b616-79954176f685 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.065356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c3060-ea4b-4467-b616-79954176f685 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.086249 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-258c3060-ea4b-4467-b616-79954176f685 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:17.086927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-3ea6ed3f-eda5-4a30-a8f1-73c635a7c2ef None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:17.087793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 283/556] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.088128 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-3ea6ed3f-eda5-4a30-a8f1-73c635a7c2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:17.088981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c3060-ea4b-4467-b616-79954176f685 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.096113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 274/557] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:17.097066 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6ed3f-eda5-4a30-a8f1-73c635a7c2ef None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.099016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c3060-ea4b-4467-b616-79954176f685 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.103637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a59f74-e6a5-4e8e-8cfd-ed1f993683c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.104520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a59f74-e6a5-4e8e-8cfd-ed1f993683c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.104875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a59f74-e6a5-4e8e-8cfd-ed1f993683c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.105166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a59f74-e6a5-4e8e-8cfd-ed1f993683c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.108667 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6ed3f-eda5-4a30-a8f1-73c635a7c2ef None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.113168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19d242-b654-4428-ae2f-d121eae611a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.114087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19d242-b654-4428-ae2f-d121eae611a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.114521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19d242-b654-4428-ae2f-d121eae611a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.114925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19d242-b654-4428-ae2f-d121eae611a8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.116237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a59f74-e6a5-4e8e-8cfd-ed1f993683c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.120957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a59f74-e6a5-4e8e-8cfd-ed1f993683c5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.130146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19d242-b654-4428-ae2f-d121eae611a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:17.137650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-7e19d242-b654-4428-ae2f-d121eae611a8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:17.138840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 275/558] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.139932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19d242-b654-4428-ae2f-d121eae611a8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.142665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-f6a59f74-e6a5-4e8e-8cfd-ed1f993683c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:17.144231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 284/559] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.145513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a59f74-e6a5-4e8e-8cfd-ed1f993683c5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.154798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19d242-b654-4428-ae2f-d121eae611a8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.155961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a59f74-e6a5-4e8e-8cfd-ed1f993683c5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.159122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7bc4c-965a-4e8a-ba70-6d8cd0783e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.159734 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7bc4c-965a-4e8a-ba70-6d8cd0783e66 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.160012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7bc4c-965a-4e8a-ba70-6d8cd0783e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.160286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7bc4c-965a-4e8a-ba70-6d8cd0783e66 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.160816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3262-ce61-4040-96bf-47f4e5f28ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.161057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7bc4c-965a-4e8a-ba70-6d8cd0783e66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.161361 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7bc4c-965a-4e8a-ba70-6d8cd0783e66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.161865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3262-ce61-4040-96bf-47f4e5f28ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.162307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3262-ce61-4040-96bf-47f4e5f28ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.162665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3262-ce61-4040-96bf-47f4e5f28ee7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.162964 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c7bc4c-965a-4e8a-ba70-6d8cd0783e66 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.174659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d3262-ce61-4040-96bf-47f4e5f28ee7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:17.175413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 276/560] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.180632 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7bc4c-965a-4e8a-ba70-6d8cd0783e66 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.182465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-e44d3262-ce61-4040-96bf-47f4e5f28ee7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:17.185167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 285/561] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.185167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3262-ce61-4040-96bf-47f4e5f28ee7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.190114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c7bc4c-965a-4e8a-ba70-6d8cd0783e66 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.194895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb71773-ac38-4181-b42f-2943eb70dc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.195484 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3262-ce61-4040-96bf-47f4e5f28ee7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.196365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb71773-ac38-4181-b42f-2943eb70dc87 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.196771 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb71773-ac38-4181-b42f-2943eb70dc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.197137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb71773-ac38-4181-b42f-2943eb70dc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.197995 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb71773-ac38-4181-b42f-2943eb70dc87 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.198393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb71773-ac38-4181-b42f-2943eb70dc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.199965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1f1ec-e562-4239-8e82-21558973741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.200179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb71773-ac38-4181-b42f-2943eb70dc87 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.200598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1f1ec-e562-4239-8e82-21558973741b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.200874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1f1ec-e562-4239-8e82-21558973741b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.201143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1f1ec-e562-4239-8e82-21558973741b admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.202045 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1f1ec-e562-4239-8e82-21558973741b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.202350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1f1ec-e562-4239-8e82-21558973741b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.204282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1f1ec-e562-4239-8e82-21558973741b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.209097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 277/562] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.214189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb71773-ac38-4181-b42f-2943eb70dc87 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.217986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 286/563] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.218683 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1f1ec-e562-4239-8e82-21558973741b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.228627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1f1ec-e562-4239-8e82-21558973741b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.228815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb71773-ac38-4181-b42f-2943eb70dc87 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.233116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae90f3e-62b3-4870-9671-2edda23df3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.233521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6eb7c-a8ce-4b24-b500-4dc4685bd3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.233906 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90f3e-62b3-4870-9671-2edda23df3c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.234183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90f3e-62b3-4870-9671-2edda23df3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.234451 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae90f3e-62b3-4870-9671-2edda23df3c3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.234549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6eb7c-a8ce-4b24-b500-4dc4685bd3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.234899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6eb7c-a8ce-4b24-b500-4dc4685bd3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.235242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6eb7c-a8ce-4b24-b500-4dc4685bd3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.236004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6eb7c-a8ce-4b24-b500-4dc4685bd3c0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.236311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6eb7c-a8ce-4b24-b500-4dc4685bd3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.237994 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6eb7c-a8ce-4b24-b500-4dc4685bd3c0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.242629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae90f3e-62b3-4870-9671-2edda23df3c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.244678 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae90f3e-62b3-4870-9671-2edda23df3c3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.246942 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 287/564] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.252798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6eb7c-a8ce-4b24-b500-4dc4685bd3c0 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.259679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-dae90f3e-62b3-4870-9671-2edda23df3c3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 13 16:36:17.266088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 278/565] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/users/cinder => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.266088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae90f3e-62b3-4870-9671-2edda23df3c3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.266284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6eb7c-a8ce-4b24-b500-4dc4685bd3c0 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.269429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a8b4-aa26-4933-b313-c51d9b200120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.270403 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a8b4-aa26-4933-b313-c51d9b200120 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.270695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a8b4-aa26-4933-b313-c51d9b200120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.270953 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a8b4-aa26-4933-b313-c51d9b200120 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.275873 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae90f3e-62b3-4870-9671-2edda23df3c3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.280193 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54403d71-9d69-4697-a927-de73b7611461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.280986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54403d71-9d69-4697-a927-de73b7611461 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.281352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54403d71-9d69-4697-a927-de73b7611461 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.281570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54403d71-9d69-4697-a927-de73b7611461 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.282280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7a8b4-aa26-4933-b313-c51d9b200120 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.284140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7a8b4-aa26-4933-b313-c51d9b200120 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.288564 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54403d71-9d69-4697-a927-de73b7611461 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.291207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54403d71-9d69-4697-a927-de73b7611461 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.300464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-98c7a8b4-aa26-4933-b313-c51d9b200120 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:17.306903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 288/566] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.306903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a8b4-aa26-4933-b313-c51d9b200120 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.307113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-54403d71-9d69-4697-a927-de73b7611461 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:17.307113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 279/567] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.307113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54403d71-9d69-4697-a927-de73b7611461 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.316982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54403d71-9d69-4697-a927-de73b7611461 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.322104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ed56d-0d5e-4b82-aed2-4368d436081b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.322583 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ed56d-0d5e-4b82-aed2-4368d436081b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.322973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ed56d-0d5e-4b82-aed2-4368d436081b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.323071 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a8b4-aa26-4933-b313-c51d9b200120 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.323248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ed56d-0d5e-4b82-aed2-4368d436081b admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.324094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ed56d-0d5e-4b82-aed2-4368d436081b admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.324460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ed56d-0d5e-4b82-aed2-4368d436081b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.326287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ed56d-0d5e-4b82-aed2-4368d436081b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.327498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb0639-6d5d-4d97-a773-1d36dde98336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.328280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0639-6d5d-4d97-a773-1d36dde98336 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.328562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0639-6d5d-4d97-a773-1d36dde98336 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.328869 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0639-6d5d-4d97-a773-1d36dde98336 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.343052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb0639-6d5d-4d97-a773-1d36dde98336 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.349276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 280/568] 10.222.0.62 () {56 vars in 1158 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.349404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb0639-6d5d-4d97-a773-1d36dde98336 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.349494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ed56d-0d5e-4b82-aed2-4368d436081b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.355019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ed56d-0d5e-4b82-aed2-4368d436081b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.359432 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b8267-c78a-4559-b7b7-759da7db8c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.360068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b8267-c78a-4559-b7b7-759da7db8c1a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.360346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b8267-c78a-4559-b7b7-759da7db8c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.360643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b8267-c78a-4559-b7b7-759da7db8c1a admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.361370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b8267-c78a-4559-b7b7-759da7db8c1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.361677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b8267-c78a-4559-b7b7-759da7db8c1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.363255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b8267-c78a-4559-b7b7-759da7db8c1a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.367631 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-46bb0639-6d5d-4d97-a773-1d36dde98336 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:17.372769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 289/569] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.372769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb0639-6d5d-4d97-a773-1d36dde98336 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.375511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 281/570] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.376193 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b8267-c78a-4559-b7b7-759da7db8c1a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.381965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb0639-6d5d-4d97-a773-1d36dde98336 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.386323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1154b9c-bb03-4440-b3a7-d1677b40f3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.386972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154b9c-bb03-4440-b3a7-d1677b40f3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.387254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154b9c-bb03-4440-b3a7-d1677b40f3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.387538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1154b9c-bb03-4440-b3a7-d1677b40f3a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.388324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1154b9c-bb03-4440-b3a7-d1677b40f3a9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.388667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1154b9c-bb03-4440-b3a7-d1677b40f3a9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.390910 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1154b9c-bb03-4440-b3a7-d1677b40f3a9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.391184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b8267-c78a-4559-b7b7-759da7db8c1a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.396101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67476ef-a490-444b-8885-95520036ce48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.397100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67476ef-a490-444b-8885-95520036ce48 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.397549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67476ef-a490-444b-8885-95520036ce48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.398722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67476ef-a490-444b-8885-95520036ce48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.404129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 290/571] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.404956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1154b9c-bb03-4440-b3a7-d1677b40f3a9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.413429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67476ef-a490-444b-8885-95520036ce48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.416197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67476ef-a490-444b-8885-95520036ce48 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.419061 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1154b9c-bb03-4440-b3a7-d1677b40f3a9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.423332 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5f2f-7ebb-4134-8937-87a8c8b63d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.423977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5f2f-7ebb-4134-8937-87a8c8b63d59 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.424258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5f2f-7ebb-4134-8937-87a8c8b63d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.424530 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5f2f-7ebb-4134-8937-87a8c8b63d59 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.425298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b5f2f-7ebb-4134-8937-87a8c8b63d59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.425603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b5f2f-7ebb-4134-8937-87a8c8b63d59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.427176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b5f2f-7ebb-4134-8937-87a8c8b63d59 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.434385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-b67476ef-a490-444b-8885-95520036ce48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:17.435783 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 282/572] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.436834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67476ef-a490-444b-8885-95520036ce48 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.443951 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 291/573] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.444648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5f2f-7ebb-4134-8937-87a8c8b63d59 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.451366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67476ef-a490-444b-8885-95520036ce48 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.455779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699187c-a8a8-41b3-8a41-a423603cce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.456557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699187c-a8a8-41b3-8a41-a423603cce15 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.456864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699187c-a8a8-41b3-8a41-a423603cce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.457131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699187c-a8a8-41b3-8a41-a423603cce15 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.457487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5f2f-7ebb-4134-8937-87a8c8b63d59 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.462064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4c83b-d999-4b8e-b79e-41c4ab7853b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.462943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4c83b-d999-4b8e-b79e-41c4ab7853b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.463222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4c83b-d999-4b8e-b79e-41c4ab7853b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.463493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4c83b-d999-4b8e-b79e-41c4ab7853b2 admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/18f1422ce48e44ab85e6d5e10d1ea898/roles/0b0b2f3132974ff2a8a6fb9683036c6e` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.466366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699187c-a8a8-41b3-8a41-a423603cce15 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.468656 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699187c-a8a8-41b3-8a41-a423603cce15 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.479300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4c83b-d999-4b8e-b79e-41c4ab7853b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=18f1422ce48e44ab85e6d5e10d1ea898, role_id=0b0b2f3132974ff2a8a6fb9683036c6e)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.481975 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4c83b-d999-4b8e-b79e-41c4ab7853b2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.484037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-d699187c-a8a8-41b3-8a41-a423603cce15 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 13 16:36:17.485474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 283/574] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/users/neutron => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.486051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699187c-a8a8-41b3-8a41-a423603cce15 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.501081 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699187c-a8a8-41b3-8a41-a423603cce15 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.515754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 292/575] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:36:17 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/18f1422ce48e44ab85e6d5e10d1ea898/roles/0b0b2f3132974ff2a8a6fb9683036c6e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:17.515754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4c83b-d999-4b8e-b79e-41c4ab7853b2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.584224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a7614-a454-4ae9-844b-85df0d2e9512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.584988 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7614-a454-4ae9-844b-85df0d2e9512 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.585234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7614-a454-4ae9-844b-85df0d2e9512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.585583 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7614-a454-4ae9-844b-85df0d2e9512 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.586334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a7614-a454-4ae9-844b-85df0d2e9512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.586645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a7614-a454-4ae9-844b-85df0d2e9512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.587945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4c83b-d999-4b8e-b79e-41c4ab7853b2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.588371 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a7614-a454-4ae9-844b-85df0d2e9512 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.593526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8643e5-5ade-4ac2-8081-740783b3e8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.594262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8643e5-5ade-4ac2-8081-740783b3e8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.594540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8643e5-5ade-4ac2-8081-740783b3e8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.594811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8643e5-5ade-4ac2-8081-740783b3e8f4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.601444 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 284/576] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.605110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8643e5-5ade-4ac2-8081-740783b3e8f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.607270 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8643e5-5ade-4ac2-8081-740783b3e8f4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.607538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a7614-a454-4ae9-844b-85df0d2e9512 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.618178 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a7614-a454-4ae9-844b-85df0d2e9512 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.623081 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f879da-8c46-4f3a-bed3-45065e382c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.623816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f879da-8c46-4f3a-bed3-45065e382c15 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.624105 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f879da-8c46-4f3a-bed3-45065e382c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.624383 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f879da-8c46-4f3a-bed3-45065e382c15 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.625016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-fc8643e5-5ade-4ac2-8081-740783b3e8f4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 13 16:36:17.625353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f879da-8c46-4f3a-bed3-45065e382c15 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.625665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f879da-8c46-4f3a-bed3-45065e382c15 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.626713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 293/577] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/users/nova => generated 82 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.627496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8643e5-5ade-4ac2-8081-740783b3e8f4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.627614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f879da-8c46-4f3a-bed3-45065e382c15 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.641325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8643e5-5ade-4ac2-8081-740783b3e8f4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.646618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84676f4a-eb15-432b-b78a-69b9a29ee8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.647427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84676f4a-eb15-432b-b78a-69b9a29ee8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.647707 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84676f4a-eb15-432b-b78a-69b9a29ee8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.648081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84676f4a-eb15-432b-b78a-69b9a29ee8e8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.653405 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 285/578] 10.222.0.62 () {56 vars in 1160 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.654463 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f879da-8c46-4f3a-bed3-45065e382c15 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.656661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84676f4a-eb15-432b-b78a-69b9a29ee8e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.658655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84676f4a-eb15-432b-b78a-69b9a29ee8e8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.665072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f879da-8c46-4f3a-bed3-45065e382c15 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.669958 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b36281-1d52-43ca-a913-08dd19f40f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.670746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b36281-1d52-43ca-a913-08dd19f40f39 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.671087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b36281-1d52-43ca-a913-08dd19f40f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.671368 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b36281-1d52-43ca-a913-08dd19f40f39 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.672290 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b36281-1d52-43ca-a913-08dd19f40f39 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.672640 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b36281-1d52-43ca-a913-08dd19f40f39 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.674712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b36281-1d52-43ca-a913-08dd19f40f39 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.675520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-84676f4a-eb15-432b-b78a-69b9a29ee8e8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:17.677306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 294/579] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.678862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84676f4a-eb15-432b-b78a-69b9a29ee8e8 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.691724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84676f4a-eb15-432b-b78a-69b9a29ee8e8 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.698158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744a8d9-45ae-4e79-9b0f-65428aa7d36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.698977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a8d9-45ae-4e79-9b0f-65428aa7d36d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.699258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a8d9-45ae-4e79-9b0f-65428aa7d36d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.699526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a8d9-45ae-4e79-9b0f-65428aa7d36d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.699831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 286/580] 10.222.0.62 () {56 vars in 1154 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.700814 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b36281-1d52-43ca-a913-08dd19f40f39 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.711716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b36281-1d52-43ca-a913-08dd19f40f39 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.713183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a8d9-45ae-4e79-9b0f-65428aa7d36d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.715623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a8d9-45ae-4e79-9b0f-65428aa7d36d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.716630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d88df-4e62-43b2-8dbc-c883ea350e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.717317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d88df-4e62-43b2-8dbc-c883ea350e36 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.717653 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d88df-4e62-43b2-8dbc-c883ea350e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.717930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d88df-4e62-43b2-8dbc-c883ea350e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.718835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d88df-4e62-43b2-8dbc-c883ea350e36 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.719144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d88df-4e62-43b2-8dbc-c883ea350e36 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.721236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d88df-4e62-43b2-8dbc-c883ea350e36 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.736619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-c744a8d9-45ae-4e79-9b0f-65428aa7d36d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:17.738178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 295/582] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.738976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744a8d9-45ae-4e79-9b0f-65428aa7d36d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.740081 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 287/582] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.741166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d88df-4e62-43b2-8dbc-c883ea350e36 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.755510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744a8d9-45ae-4e79-9b0f-65428aa7d36d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.755844 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d88df-4e62-43b2-8dbc-c883ea350e36 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.760830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4b841-183b-4518-9e78-35a58ade2054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.761264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b7e10-258d-405d-9e9e-4fae10bbc69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.761799 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4b841-183b-4518-9e78-35a58ade2054 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.762084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b7e10-258d-405d-9e9e-4fae10bbc69c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.762254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4b841-183b-4518-9e78-35a58ade2054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.762397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4b841-183b-4518-9e78-35a58ade2054 admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/20f42eb51a824f69a6f77c5044300da2/roles/0b0b2f3132974ff2a8a6fb9683036c6e` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.762535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b7e10-258d-405d-9e9e-4fae10bbc69c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.762672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b7e10-258d-405d-9e9e-4fae10bbc69c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.776955 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b7e10-258d-405d-9e9e-4fae10bbc69c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.779640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b7e10-258d-405d-9e9e-4fae10bbc69c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.781311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4b841-183b-4518-9e78-35a58ade2054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=20f42eb51a824f69a6f77c5044300da2, role_id=0b0b2f3132974ff2a8a6fb9683036c6e)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.784059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4b841-183b-4518-9e78-35a58ade2054 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.798498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-ac9b7e10-258d-405d-9e9e-4fae10bbc69c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:17.800019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 296/583] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.800856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b7e10-258d-405d-9e9e-4fae10bbc69c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.809160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 288/584] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:36:17 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/20f42eb51a824f69a6f77c5044300da2/roles/0b0b2f3132974ff2a8a6fb9683036c6e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:17.809511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4b841-183b-4518-9e78-35a58ade2054 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.816834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b7e10-258d-405d-9e9e-4fae10bbc69c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.882087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4b841-183b-4518-9e78-35a58ade2054 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.887460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec470384-15ec-43ae-a622-bb54a5da160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.888131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec470384-15ec-43ae-a622-bb54a5da160a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.888417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec470384-15ec-43ae-a622-bb54a5da160a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.888717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec470384-15ec-43ae-a622-bb54a5da160a admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.889462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec470384-15ec-43ae-a622-bb54a5da160a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.889763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec470384-15ec-43ae-a622-bb54a5da160a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.891862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec470384-15ec-43ae-a622-bb54a5da160a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.893578 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf252537-5001-4bc2-8ed7-bdc2198c1bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.894594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf252537-5001-4bc2-8ed7-bdc2198c1bff admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.895162 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf252537-5001-4bc2-8ed7-bdc2198c1bff admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.895686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf252537-5001-4bc2-8ed7-bdc2198c1bff admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.896766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf252537-5001-4bc2-8ed7-bdc2198c1bff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.897281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf252537-5001-4bc2-8ed7-bdc2198c1bff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.899592 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf252537-5001-4bc2-8ed7-bdc2198c1bff admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.909794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 289/585] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.913104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec470384-15ec-43ae-a622-bb54a5da160a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.918918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 297/586] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:17.925038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec470384-15ec-43ae-a622-bb54a5da160a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.925249 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf252537-5001-4bc2-8ed7-bdc2198c1bff admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.930919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3e29f-4e24-4979-b824-97eaf6bc9d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.931912 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e29f-4e24-4979-b824-97eaf6bc9d91 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.932343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e29f-4e24-4979-b824-97eaf6bc9d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.932752 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3e29f-4e24-4979-b824-97eaf6bc9d91 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.937696 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf252537-5001-4bc2-8ed7-bdc2198c1bff admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.941625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3e29f-4e24-4979-b824-97eaf6bc9d91 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.942837 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf38a90-6ea9-4b58-ac80-d5dc56beec2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.943810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf38a90-6ea9-4b58-ac80-d5dc56beec2d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.943923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3e29f-4e24-4979-b824-97eaf6bc9d91 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.944323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf38a90-6ea9-4b58-ac80-d5dc56beec2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.945118 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf38a90-6ea9-4b58-ac80-d5dc56beec2d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.953524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf38a90-6ea9-4b58-ac80-d5dc56beec2d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.955786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf38a90-6ea9-4b58-ac80-d5dc56beec2d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:17.959882 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-36c3e29f-4e24-4979-b824-97eaf6bc9d91 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:17.966200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 290/587] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:17.966200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ad37a-c66a-4cd4-9bac-7b876ab8fa5d None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.966200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ad37a-c66a-4cd4-9bac-7b876ab8fa5d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.966200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ad37a-c66a-4cd4-9bac-7b876ab8fa5d None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.966200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 291/588] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:17.973777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ad37a-c66a-4cd4-9bac-7b876ab8fa5d None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:17.981508 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-2bf38a90-6ea9-4b58-ac80-d5dc56beec2d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:17.983464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 298/589] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:17.985048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc311326-aa78-4cdc-902b-6c70ab5be179 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.985712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc311326-aa78-4cdc-902b-6c70ab5be179 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.986128 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc311326-aa78-4cdc-902b-6c70ab5be179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.986919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ad37a-c66a-4cd4-9bac-7b876ab8fa5d None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:17.991651 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e493b-2556-47de-b9a5-bcf845d30d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:17.992893 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e493b-2556-47de-b9a5-bcf845d30d3b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:17.993282 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e493b-2556-47de-b9a5-bcf845d30d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:17.993660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024e493b-2556-47de-b9a5-bcf845d30d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:17.994578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e493b-2556-47de-b9a5-bcf845d30d3b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:17.995256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e493b-2556-47de-b9a5-bcf845d30d3b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:17.998021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024e493b-2556-47de-b9a5-bcf845d30d3b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.011050 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-cc311326-aa78-4cdc-902b-6c70ab5be179 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:18.012284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cc311326-aa78-4cdc-902b-6c70ab5be179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:18.013852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 292/590] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:18.014959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e493b-2556-47de-b9a5-bcf845d30d3b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.027008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 299/591] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:18.032526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc311326-aa78-4cdc-902b-6c70ab5be179 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.038267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024e493b-2556-47de-b9a5-bcf845d30d3b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.042423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc311326-aa78-4cdc-902b-6c70ab5be179 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.050699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccf26b-4e0d-4e11-ac9f-67458b89318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.051698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c008b-e888-4046-8767-550ac6ce3667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.052410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c008b-e888-4046-8767-550ac6ce3667 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.052720 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c008b-e888-4046-8767-550ac6ce3667 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.052993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c008b-e888-4046-8767-550ac6ce3667 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.053804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c008b-e888-4046-8767-550ac6ce3667 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:18.054215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c008b-e888-4046-8767-550ac6ce3667 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.056184 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf26b-4e0d-4e11-ac9f-67458b89318c admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.056385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf26b-4e0d-4e11-ac9f-67458b89318c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.056639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccf26b-4e0d-4e11-ac9f-67458b89318c admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/dfecc747eb8d431a8d57f4534d259de8/roles/0b0b2f3132974ff2a8a6fb9683036c6e` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.057629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c008b-e888-4046-8767-550ac6ce3667 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.073372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccf26b-4e0d-4e11-ac9f-67458b89318c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=dfecc747eb8d431a8d57f4534d259de8, role_id=0b0b2f3132974ff2a8a6fb9683036c6e)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.075102 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 293/592] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:18.076206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c008b-e888-4046-8767-550ac6ce3667 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.076310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ccf26b-4e0d-4e11-ac9f-67458b89318c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.092069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c008b-e888-4046-8767-550ac6ce3667 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.098905 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 300/593] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:36:18 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/dfecc747eb8d431a8d57f4534d259de8/roles/0b0b2f3132974ff2a8a6fb9683036c6e => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:18.099710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccf26b-4e0d-4e11-ac9f-67458b89318c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.178192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cbcc3-ee94-425b-90ba-fdbb585645a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.180028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cbcc3-ee94-425b-90ba-fdbb585645a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.182710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cbcc3-ee94-425b-90ba-fdbb585645a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.183175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cbcc3-ee94-425b-90ba-fdbb585645a6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.204054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ccf26b-4e0d-4e11-ac9f-67458b89318c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.209503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cbcc3-ee94-425b-90ba-fdbb585645a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:18.217871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15273ee5-c016-4396-a2dd-308ff1dd78ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.219068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273ee5-c016-4396-a2dd-308ff1dd78ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.219489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273ee5-c016-4396-a2dd-308ff1dd78ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.219908 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15273ee5-c016-4396-a2dd-308ff1dd78ef admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/51f9a10e3d87475e92fb49686f1aa456/roles/0b0b2f3132974ff2a8a6fb9683036c6e` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.230416 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-2a7cbcc3-ee94-425b-90ba-fdbb585645a6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:18.232095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 294/594] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:18.238053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cbcc3-ee94-425b-90ba-fdbb585645a6 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.244039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15273ee5-c016-4396-a2dd-308ff1dd78ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=51f9a10e3d87475e92fb49686f1aa456, role_id=0b0b2f3132974ff2a8a6fb9683036c6e)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.249491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15273ee5-c016-4396-a2dd-308ff1dd78ef admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.259038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cbcc3-ee94-425b-90ba-fdbb585645a6 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.266228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ba661-e8ca-4cd0-a765-54fc122cfef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.267267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba661-e8ca-4cd0-a765-54fc122cfef8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.267903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba661-e8ca-4cd0-a765-54fc122cfef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.268323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ba661-e8ca-4cd0-a765-54fc122cfef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.269370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ba661-e8ca-4cd0-a765-54fc122cfef8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:18.269903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ba661-e8ca-4cd0-a765-54fc122cfef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.278812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 301/595] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:36:18 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/51f9a10e3d87475e92fb49686f1aa456/roles/0b0b2f3132974ff2a8a6fb9683036c6e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:18.280985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ba661-e8ca-4cd0-a765-54fc122cfef8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.297857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 295/596] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:18.304215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15273ee5-c016-4396-a2dd-308ff1dd78ef admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.389122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15273ee5-c016-4396-a2dd-308ff1dd78ef admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.394325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4546fe-ee16-4208-8b39-f4315c324d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.395170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4546fe-ee16-4208-8b39-f4315c324d8a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.395490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4546fe-ee16-4208-8b39-f4315c324d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.395769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4546fe-ee16-4208-8b39-f4315c324d8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.408347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4546fe-ee16-4208-8b39-f4315c324d8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.410424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4546fe-ee16-4208-8b39-f4315c324d8a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.430471 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-1e4546fe-ee16-4208-8b39-f4315c324d8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:18.431974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 302/597] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 128 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:18.438425 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ba661-e8ca-4cd0-a765-54fc122cfef8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.452924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ba661-e8ca-4cd0-a765-54fc122cfef8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.459128 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8853a1-05dd-4c8c-a2ea-549241a74978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.460154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8853a1-05dd-4c8c-a2ea-549241a74978 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.460698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8853a1-05dd-4c8c-a2ea-549241a74978 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.461198 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8853a1-05dd-4c8c-a2ea-549241a74978 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.462143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8853a1-05dd-4c8c-a2ea-549241a74978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:18.462640 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8853a1-05dd-4c8c-a2ea-549241a74978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.464460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8853a1-05dd-4c8c-a2ea-549241a74978 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.477701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 296/598] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:18.483451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4546fe-ee16-4208-8b39-f4315c324d8a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.493573 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4546fe-ee16-4208-8b39-f4315c324d8a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.498202 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a7e8a-b429-4423-99ff-071b512b15c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.499022 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7e8a-b429-4423-99ff-071b512b15c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.499355 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7e8a-b429-4423-99ff-071b512b15c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.499629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a7e8a-b429-4423-99ff-071b512b15c7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.508524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a7e8a-b429-4423-99ff-071b512b15c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.510764 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a7e8a-b429-4423-99ff-071b512b15c7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.535245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-638a7e8a-b429-4423-99ff-071b512b15c7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 13 16:36:18.536880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 303/599] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:18.543497 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8853a1-05dd-4c8c-a2ea-549241a74978 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.557816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8853a1-05dd-4c8c-a2ea-549241a74978 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.574764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8dde-3f74-41eb-a66e-7c83b318e727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.575513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8dde-3f74-41eb-a66e-7c83b318e727 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.575745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8dde-3f74-41eb-a66e-7c83b318e727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.576017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf8dde-3f74-41eb-a66e-7c83b318e727 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.576920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf8dde-3f74-41eb-a66e-7c83b318e727 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:18.577225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf8dde-3f74-41eb-a66e-7c83b318e727 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.579112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf8dde-3f74-41eb-a66e-7c83b318e727 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.611975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 297/600] 10.222.0.62 () {56 vars in 1156 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:18.618459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a7e8a-b429-4423-99ff-071b512b15c7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.631318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a7e8a-b429-4423-99ff-071b512b15c7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.637213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235be9bd-f222-4776-a2ce-2a27df4af538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.637874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235be9bd-f222-4776-a2ce-2a27df4af538 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.638212 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235be9bd-f222-4776-a2ce-2a27df4af538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.638493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235be9bd-f222-4776-a2ce-2a27df4af538 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.649788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235be9bd-f222-4776-a2ce-2a27df4af538 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.651599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235be9bd-f222-4776-a2ce-2a27df4af538 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.661178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 304/601] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:18.667448 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8dde-3f74-41eb-a66e-7c83b318e727 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.677584 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf8dde-3f74-41eb-a66e-7c83b318e727 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.682222 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce69f2-f8cb-45cd-a2f5-10d6450811dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.683025 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce69f2-f8cb-45cd-a2f5-10d6450811dd admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.683309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce69f2-f8cb-45cd-a2f5-10d6450811dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.683584 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce69f2-f8cb-45cd-a2f5-10d6450811dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.694916 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce69f2-f8cb-45cd-a2f5-10d6450811dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.696914 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce69f2-f8cb-45cd-a2f5-10d6450811dd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.714994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-b1ce69f2-f8cb-45cd-a2f5-10d6450811dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:18.716622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 298/602] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:18.722708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235be9bd-f222-4776-a2ce-2a27df4af538 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.732744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235be9bd-f222-4776-a2ce-2a27df4af538 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.737398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cd098-c284-4b5a-8e9a-fc8cffddfe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.738055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd098-c284-4b5a-8e9a-fc8cffddfe0a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.738337 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd098-c284-4b5a-8e9a-fc8cffddfe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.738611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cd098-c284-4b5a-8e9a-fc8cffddfe0a admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.739343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cd098-c284-4b5a-8e9a-fc8cffddfe0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:18.739702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cd098-c284-4b5a-8e9a-fc8cffddfe0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.741376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cd098-c284-4b5a-8e9a-fc8cffddfe0a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.755046 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 305/603] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:18.761260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce69f2-f8cb-45cd-a2f5-10d6450811dd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.771702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce69f2-f8cb-45cd-a2f5-10d6450811dd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.776580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161e11b-3b0e-4eaf-869e-f6d2c827e160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.777445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161e11b-3b0e-4eaf-869e-f6d2c827e160 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.777726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161e11b-3b0e-4eaf-869e-f6d2c827e160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.778002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161e11b-3b0e-4eaf-869e-f6d2c827e160 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.785773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161e11b-3b0e-4eaf-869e-f6d2c827e160 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.787832 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161e11b-3b0e-4eaf-869e-f6d2c827e160 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.801398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-c161e11b-3b0e-4eaf-869e-f6d2c827e160 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:18.802942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 299/604] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:18.809362 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cd098-c284-4b5a-8e9a-fc8cffddfe0a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.819421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cd098-c284-4b5a-8e9a-fc8cffddfe0a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.824043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ab9dc-c9af-47a5-84e5-5a437de184f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.824795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ab9dc-c9af-47a5-84e5-5a437de184f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.825132 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ab9dc-c9af-47a5-84e5-5a437de184f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.825409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ab9dc-c9af-47a5-84e5-5a437de184f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.826212 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ab9dc-c9af-47a5-84e5-5a437de184f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:18.826517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ab9dc-c9af-47a5-84e5-5a437de184f0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.828428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ab9dc-c9af-47a5-84e5-5a437de184f0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.841876 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 306/605] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:18.848336 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161e11b-3b0e-4eaf-869e-f6d2c827e160 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:18.859541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161e11b-3b0e-4eaf-869e-f6d2c827e160 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:18.864199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331898b-a1dc-4258-b120-6e77879d50d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:18.864939 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331898b-a1dc-4258-b120-6e77879d50d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:18.865220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331898b-a1dc-4258-b120-6e77879d50d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:18.865494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331898b-a1dc-4258-b120-6e77879d50d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:18.866357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331898b-a1dc-4258-b120-6e77879d50d4 admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=940c2c607c7b4f949593791360f99fbd) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:18.866895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331898b-a1dc-4258-b120-6e77879d50d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:18.870559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331898b-a1dc-4258-b120-6e77879d50d4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:18.877118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 300/606] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:18 2021] GET /identity/v3/role_assignments?user.id=940c2c607c7b4f949593791360f99fbd&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:20.436385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d456-841f-4b7d-841b-043ec9bb85b7 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.437113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d456-841f-4b7d-841b-043ec9bb85b7 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.437113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5d456-841f-4b7d-841b-043ec9bb85b7 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.440560 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 307/607] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:20 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:20.447100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80500f25-009b-41e5-abae-4b784e9a38ab None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.447693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80500f25-009b-41e5-abae-4b784e9a38ab None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.447693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80500f25-009b-41e5-abae-4b784e9a38ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.473126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-80500f25-009b-41e5-abae-4b784e9a38ab None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:20.474408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-80500f25-009b-41e5-abae-4b784e9a38ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:20.487926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 301/608] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:20.531189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5d456-841f-4b7d-841b-043ec9bb85b7 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:20.545425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5d456-841f-4b7d-841b-043ec9bb85b7 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:20.553311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b99b7-e996-4d6d-9499-dc357222643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:20.555279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b99b7-e996-4d6d-9499-dc357222643b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.555279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b99b7-e996-4d6d-9499-dc357222643b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.555279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b99b7-e996-4d6d-9499-dc357222643b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.573602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b99b7-e996-4d6d-9499-dc357222643b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:20.580680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-2b0b99b7-e996-4d6d-9499-dc357222643b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:20.582802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 308/609] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:20 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:20.589780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80500f25-009b-41e5-abae-4b784e9a38ab None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:20.599164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80500f25-009b-41e5-abae-4b784e9a38ab None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:20.609448 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e06e46-d6fc-4bcd-8d55-d54b882940f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:20.610235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e06e46-d6fc-4bcd-8d55-d54b882940f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.610588 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e06e46-d6fc-4bcd-8d55-d54b882940f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.610930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e06e46-d6fc-4bcd-8d55-d54b882940f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.611779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e06e46-d6fc-4bcd-8d55-d54b882940f7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:20.612162 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e06e46-d6fc-4bcd-8d55-d54b882940f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:20.613874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e06e46-d6fc-4bcd-8d55-d54b882940f7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:20.623437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 302/610] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:20 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:20.629346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b99b7-e996-4d6d-9499-dc357222643b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:20.639641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b99b7-e996-4d6d-9499-dc357222643b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:20.644526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99200d7-8f76-4d08-b522-4f40f9a9a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:20.645411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99200d7-8f76-4d08-b522-4f40f9a9a6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.645768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99200d7-8f76-4d08-b522-4f40f9a9a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.646110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99200d7-8f76-4d08-b522-4f40f9a9a6b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.657774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99200d7-8f76-4d08-b522-4f40f9a9a6b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:20.659739 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99200d7-8f76-4d08-b522-4f40f9a9a6b6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:20.676381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-e99200d7-8f76-4d08-b522-4f40f9a9a6b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:20.677990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 309/611] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:20.684172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e06e46-d6fc-4bcd-8d55-d54b882940f7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:20.694336 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e06e46-d6fc-4bcd-8d55-d54b882940f7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:20.698917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f038f-953c-4a0d-a7eb-3a6d80c0245e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:20.699653 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f038f-953c-4a0d-a7eb-3a6d80c0245e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.700006 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f038f-953c-4a0d-a7eb-3a6d80c0245e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.700348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f038f-953c-4a0d-a7eb-3a6d80c0245e admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.701197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f038f-953c-4a0d-a7eb-3a6d80c0245e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:20.701570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f038f-953c-4a0d-a7eb-3a6d80c0245e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:20.703237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f038f-953c-4a0d-a7eb-3a6d80c0245e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:20.716125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 303/612] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:20.722058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99200d7-8f76-4d08-b522-4f40f9a9a6b6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:20.735978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99200d7-8f76-4d08-b522-4f40f9a9a6b6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:20.740611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504bd06-66e0-4958-867f-bc7c59754528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:20.741511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bd06-66e0-4958-867f-bc7c59754528 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.741870 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bd06-66e0-4958-867f-bc7c59754528 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.742215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4504bd06-66e0-4958-867f-bc7c59754528 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.750492 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504bd06-66e0-4958-867f-bc7c59754528 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:20.752647 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4504bd06-66e0-4958-867f-bc7c59754528 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:20.766792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-4504bd06-66e0-4958-867f-bc7c59754528 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Dec 13 16:36:20.768402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 310/613] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:20 2021] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:20.774652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f038f-953c-4a0d-a7eb-3a6d80c0245e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:20.784901 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f038f-953c-4a0d-a7eb-3a6d80c0245e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:20.789728 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a85fe-5e0e-45c4-b0d0-d030c83e1f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:20.790521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a85fe-5e0e-45c4-b0d0-d030c83e1f5e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.790874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a85fe-5e0e-45c4-b0d0-d030c83e1f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.791270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a85fe-5e0e-45c4-b0d0-d030c83e1f5e admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.792191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a85fe-5e0e-45c4-b0d0-d030c83e1f5e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:20.792628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a85fe-5e0e-45c4-b0d0-d030c83e1f5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:20.794569 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a85fe-5e0e-45c4-b0d0-d030c83e1f5e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:20.813205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 304/614] 10.222.0.62 () {56 vars in 1158 bytes} [Mon Dec 13 16:36:20 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:20.819291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504bd06-66e0-4958-867f-bc7c59754528 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:20.829585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4504bd06-66e0-4958-867f-bc7c59754528 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:20.834115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfa472-9f02-4042-86fa-feebf42cbb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:20.834825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfa472-9f02-4042-86fa-feebf42cbb55 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.835107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfa472-9f02-4042-86fa-feebf42cbb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.835519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdfa472-9f02-4042-86fa-feebf42cbb55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.844879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfa472-9f02-4042-86fa-feebf42cbb55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:20.846700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdfa472-9f02-4042-86fa-feebf42cbb55 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:20.861093 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 311/615] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:20.867376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a85fe-5e0e-45c4-b0d0-d030c83e1f5e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:20.877541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a85fe-5e0e-45c4-b0d0-d030c83e1f5e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:20.882135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94002cb-9b8f-4cbc-9e6c-301386d54079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:20.883001 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94002cb-9b8f-4cbc-9e6c-301386d54079 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.883281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94002cb-9b8f-4cbc-9e6c-301386d54079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.883605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94002cb-9b8f-4cbc-9e6c-301386d54079 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.894910 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94002cb-9b8f-4cbc-9e6c-301386d54079 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:20.896842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94002cb-9b8f-4cbc-9e6c-301386d54079 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:20.915553 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a94002cb-9b8f-4cbc-9e6c-301386d54079 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:20.917134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 305/616] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:20.923195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfa472-9f02-4042-86fa-feebf42cbb55 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:20.932676 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdfa472-9f02-4042-86fa-feebf42cbb55 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:20.937351 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4dc7c-425d-4aec-b5bb-f2a26fde9103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:20.938062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4dc7c-425d-4aec-b5bb-f2a26fde9103 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.938346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4dc7c-425d-4aec-b5bb-f2a26fde9103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.938623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4dc7c-425d-4aec-b5bb-f2a26fde9103 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.939366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4dc7c-425d-4aec-b5bb-f2a26fde9103 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:20.939670 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4dc7c-425d-4aec-b5bb-f2a26fde9103 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:20.941370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4dc7c-425d-4aec-b5bb-f2a26fde9103 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:20.955273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 312/617] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:20.961231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94002cb-9b8f-4cbc-9e6c-301386d54079 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:20.971497 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94002cb-9b8f-4cbc-9e6c-301386d54079 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:20.981037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059e2b9-5715-4c76-a33a-6d514950613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:20.981937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059e2b9-5715-4c76-a33a-6d514950613d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.982219 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059e2b9-5715-4c76-a33a-6d514950613d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.982494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059e2b9-5715-4c76-a33a-6d514950613d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.994794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059e2b9-5715-4c76-a33a-6d514950613d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:20.995098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12636b-8faa-4d9e-91cb-44751532df48 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:20.995098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12636b-8faa-4d9e-91cb-44751532df48 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:20.995098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12636b-8faa-4d9e-91cb-44751532df48 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:20.995098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 313/618] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:20.997710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059e2b9-5715-4c76-a33a-6d514950613d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.003520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93cb75-456f-4649-b16e-3bdc6a9b22e0 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.004401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93cb75-456f-4649-b16e-3bdc6a9b22e0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.005177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93cb75-456f-4649-b16e-3bdc6a9b22e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.016643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-f059e2b9-5715-4c76-a33a-6d514950613d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:21.018149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 306/619] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:21.024619 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059e2b9-5715-4c76-a33a-6d514950613d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.027309 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-4b93cb75-456f-4649-b16e-3bdc6a9b22e0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:21.028497 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4b93cb75-456f-4649-b16e-3bdc6a9b22e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:21.037796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 314/620] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:21.043081 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059e2b9-5715-4c76-a33a-6d514950613d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.058664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a77c9-2e3e-4c3b-98ba-13dab4d148e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.059341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a77c9-2e3e-4c3b-98ba-13dab4d148e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.059614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a77c9-2e3e-4c3b-98ba-13dab4d148e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.060082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a77c9-2e3e-4c3b-98ba-13dab4d148e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.060914 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a77c9-2e3e-4c3b-98ba-13dab4d148e3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.061216 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a77c9-2e3e-4c3b-98ba-13dab4d148e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.063078 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a77c9-2e3e-4c3b-98ba-13dab4d148e3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.068295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93cb75-456f-4649-b16e-3bdc6a9b22e0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.078538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93cb75-456f-4649-b16e-3bdc6a9b22e0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.081615 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 307/621] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:21.083158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7cc69-5596-4eb9-a467-a339a35c6a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.083960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7cc69-5596-4eb9-a467-a339a35c6a64 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.084241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7cc69-5596-4eb9-a467-a339a35c6a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.084517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7cc69-5596-4eb9-a467-a339a35c6a64 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.087903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a77c9-2e3e-4c3b-98ba-13dab4d148e3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.096247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7cc69-5596-4eb9-a467-a339a35c6a64 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:21.103656 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-89e7cc69-5596-4eb9-a467-a339a35c6a64 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:21.105259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 315/622] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:21.105452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a77c9-2e3e-4c3b-98ba-13dab4d148e3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.111417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7cc69-5596-4eb9-a467-a339a35c6a64 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.114131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523d862-825a-49bc-818b-e9f94a467d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.114786 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523d862-825a-49bc-818b-e9f94a467d48 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.115064 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523d862-825a-49bc-818b-e9f94a467d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.115332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523d862-825a-49bc-818b-e9f94a467d48 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.116172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523d862-825a-49bc-818b-e9f94a467d48 admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=18f1422ce48e44ab85e6d5e10d1ea898) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.116504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523d862-825a-49bc-818b-e9f94a467d48 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.118423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523d862-825a-49bc-818b-e9f94a467d48 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.122160 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7cc69-5596-4eb9-a467-a339a35c6a64 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.128207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282a164-7d07-46e6-9104-aeee2e9c7efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.128890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a164-7d07-46e6-9104-aeee2e9c7efc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.131319 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a164-7d07-46e6-9104-aeee2e9c7efc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.131687 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282a164-7d07-46e6-9104-aeee2e9c7efc admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.132546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282a164-7d07-46e6-9104-aeee2e9c7efc admin admin] RBAC: Adding query filter params (name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.132900 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282a164-7d07-46e6-9104-aeee2e9c7efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.134227 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 308/623] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/role_assignments?user.id=18f1422ce48e44ab85e6d5e10d1ea898&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:21.134932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282a164-7d07-46e6-9104-aeee2e9c7efc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.146398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 316/624] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:21.152664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523d862-825a-49bc-818b-e9f94a467d48 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.163833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523d862-825a-49bc-818b-e9f94a467d48 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.171000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f091dac-fcf9-4347-a4fd-8aa57d667804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.171862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f091dac-fcf9-4347-a4fd-8aa57d667804 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.172147 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f091dac-fcf9-4347-a4fd-8aa57d667804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.172421 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f091dac-fcf9-4347-a4fd-8aa57d667804 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.189034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f091dac-fcf9-4347-a4fd-8aa57d667804 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.190950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f091dac-fcf9-4347-a4fd-8aa57d667804 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.216182 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-4f091dac-fcf9-4347-a4fd-8aa57d667804 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:21.222168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 309/625] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:21.228779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282a164-7d07-46e6-9104-aeee2e9c7efc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.239532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282a164-7d07-46e6-9104-aeee2e9c7efc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.244545 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab221-9c7b-43d2-8998-7cfa4f9fc5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.245426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab221-9c7b-43d2-8998-7cfa4f9fc5df admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.245708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab221-9c7b-43d2-8998-7cfa4f9fc5df admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.245982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feab221-9c7b-43d2-8998-7cfa4f9fc5df admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.246797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab221-9c7b-43d2-8998-7cfa4f9fc5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.247150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab221-9c7b-43d2-8998-7cfa4f9fc5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.248925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feab221-9c7b-43d2-8998-7cfa4f9fc5df admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.262490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 317/626] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:21.268989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f091dac-fcf9-4347-a4fd-8aa57d667804 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.279428 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f091dac-fcf9-4347-a4fd-8aa57d667804 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.284107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70685daa-2512-4011-8cf6-6bd15eaaab88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.284980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70685daa-2512-4011-8cf6-6bd15eaaab88 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.285261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70685daa-2512-4011-8cf6-6bd15eaaab88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.285588 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70685daa-2512-4011-8cf6-6bd15eaaab88 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.302355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70685daa-2512-4011-8cf6-6bd15eaaab88 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.304662 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70685daa-2512-4011-8cf6-6bd15eaaab88 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.329631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-70685daa-2512-4011-8cf6-6bd15eaaab88 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 13 16:36:21.333600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 310/627] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/users/cinder => generated 84 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:21.338099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab221-9c7b-43d2-8998-7cfa4f9fc5df admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.348557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feab221-9c7b-43d2-8998-7cfa4f9fc5df admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.367275 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e95d67-ce4a-4dc0-8cd5-021dfac820dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.367973 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e95d67-ce4a-4dc0-8cd5-021dfac820dc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.368256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e95d67-ce4a-4dc0-8cd5-021dfac820dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.368531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e95d67-ce4a-4dc0-8cd5-021dfac820dc admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.369429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e95d67-ce4a-4dc0-8cd5-021dfac820dc admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.369737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e95d67-ce4a-4dc0-8cd5-021dfac820dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.371614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e95d67-ce4a-4dc0-8cd5-021dfac820dc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.408368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 318/628] 10.222.0.62 () {56 vars in 1158 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:21.414716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70685daa-2512-4011-8cf6-6bd15eaaab88 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.426667 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70685daa-2512-4011-8cf6-6bd15eaaab88 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.438075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd542b7e-1353-4670-886d-6f4b85c99b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.439128 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542b7e-1353-4670-886d-6f4b85c99b8f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.439635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542b7e-1353-4670-886d-6f4b85c99b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.440095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd542b7e-1353-4670-886d-6f4b85c99b8f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.457952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd542b7e-1353-4670-886d-6f4b85c99b8f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.460684 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd542b7e-1353-4670-886d-6f4b85c99b8f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.469103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee843f6-5785-4455-9365-e274b540d790 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.469651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee843f6-5785-4455-9365-e274b540d790 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.469651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee843f6-5785-4455-9365-e274b540d790 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.471736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 319/629] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:21.474500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 311/630] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:21.482367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241d4ff-3c76-4242-b8e4-28c2bf0be9d3 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.482704 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241d4ff-3c76-4242-b8e4-28c2bf0be9d3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.482919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241d4ff-3c76-4242-b8e4-28c2bf0be9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.485291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd542b7e-1353-4670-886d-6f4b85c99b8f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.496748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd542b7e-1353-4670-886d-6f4b85c99b8f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.502585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80fff-ec50-4c37-a28a-e70d39d81fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.503371 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80fff-ec50-4c37-a28a-e70d39d81fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.503647 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80fff-ec50-4c37-a28a-e70d39d81fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.503914 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac80fff-ec50-4c37-a28a-e70d39d81fa9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.514861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-4241d4ff-3c76-4242-b8e4-28c2bf0be9d3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:21.515020 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80fff-ec50-4c37-a28a-e70d39d81fa9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.516821 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4241d4ff-3c76-4242-b8e4-28c2bf0be9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:21.517201 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac80fff-ec50-4c37-a28a-e70d39d81fa9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.527183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 320/631] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:21.544797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-dac80fff-ec50-4c37-a28a-e70d39d81fa9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:21.546315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 312/632] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:21.551938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241d4ff-3c76-4242-b8e4-28c2bf0be9d3 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.554913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80fff-ec50-4c37-a28a-e70d39d81fa9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.568798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241d4ff-3c76-4242-b8e4-28c2bf0be9d3 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.574087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac80fff-ec50-4c37-a28a-e70d39d81fa9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.576055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146fef0-24b6-4393-8fe7-2589b875d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.577189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146fef0-24b6-4393-8fe7-2589b875d896 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.577832 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146fef0-24b6-4393-8fe7-2589b875d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.578331 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146fef0-24b6-4393-8fe7-2589b875d896 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.578887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118848ec-a8f2-4958-8b1e-8a0e99866ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.579411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146fef0-24b6-4393-8fe7-2589b875d896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.579884 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118848ec-a8f2-4958-8b1e-8a0e99866ffc admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.580073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146fef0-24b6-4393-8fe7-2589b875d896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.580354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118848ec-a8f2-4958-8b1e-8a0e99866ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.580760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118848ec-a8f2-4958-8b1e-8a0e99866ffc admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.582422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146fef0-24b6-4393-8fe7-2589b875d896 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.591658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118848ec-a8f2-4958-8b1e-8a0e99866ffc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:21.598795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-118848ec-a8f2-4958-8b1e-8a0e99866ffc admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:21.598956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 321/633] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:21.600870 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 313/634] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:21.604406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146fef0-24b6-4393-8fe7-2589b875d896 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.609625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118848ec-a8f2-4958-8b1e-8a0e99866ffc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.614935 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146fef0-24b6-4393-8fe7-2589b875d896 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.619837 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118848ec-a8f2-4958-8b1e-8a0e99866ffc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.621147 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c9558-7c31-4d2a-aa09-7c5c41f0d54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.622345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c9558-7c31-4d2a-aa09-7c5c41f0d54d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.622899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c9558-7c31-4d2a-aa09-7c5c41f0d54d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.623417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c9558-7c31-4d2a-aa09-7c5c41f0d54d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.624809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eb4b6-475a-41e6-b724-87c40aa9de38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.625555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eb4b6-475a-41e6-b724-87c40aa9de38 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.626034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eb4b6-475a-41e6-b724-87c40aa9de38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.626267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5eb4b6-475a-41e6-b724-87c40aa9de38 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.627355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eb4b6-475a-41e6-b724-87c40aa9de38 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.627476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eb4b6-475a-41e6-b724-87c40aa9de38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.629231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5eb4b6-475a-41e6-b724-87c40aa9de38 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.632882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c9558-7c31-4d2a-aa09-7c5c41f0d54d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.635091 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c9558-7c31-4d2a-aa09-7c5c41f0d54d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.639198 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 314/635] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:21.645401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eb4b6-475a-41e6-b724-87c40aa9de38 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.652288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-353c9558-7c31-4d2a-aa09-7c5c41f0d54d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:21.654874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 322/636] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:21.657507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5eb4b6-475a-41e6-b724-87c40aa9de38 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.660919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c9558-7c31-4d2a-aa09-7c5c41f0d54d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.662795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f28e87-ca72-487f-a64a-925bd2c5af48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.663839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f28e87-ca72-487f-a64a-925bd2c5af48 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.664354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f28e87-ca72-487f-a64a-925bd2c5af48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.665033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f28e87-ca72-487f-a64a-925bd2c5af48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.671519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c9558-7c31-4d2a-aa09-7c5c41f0d54d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.676807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70678a-8156-4bb0-92ce-bb1ad3993f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.677463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70678a-8156-4bb0-92ce-bb1ad3993f4f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.677761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70678a-8156-4bb0-92ce-bb1ad3993f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.678034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70678a-8156-4bb0-92ce-bb1ad3993f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.678805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70678a-8156-4bb0-92ce-bb1ad3993f4f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.679142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70678a-8156-4bb0-92ce-bb1ad3993f4f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.679394 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f28e87-ca72-487f-a64a-925bd2c5af48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.681032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70678a-8156-4bb0-92ce-bb1ad3993f4f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.681683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f28e87-ca72-487f-a64a-925bd2c5af48 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.694109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 323/637] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:21.701288 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-d0f28e87-ca72-487f-a64a-925bd2c5af48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:21.701452 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70678a-8156-4bb0-92ce-bb1ad3993f4f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.702907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 315/638] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:21.715107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f28e87-ca72-487f-a64a-925bd2c5af48 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.718286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70678a-8156-4bb0-92ce-bb1ad3993f4f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.723777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8db78-c023-4ffe-a6c0-46381581add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.724620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8db78-c023-4ffe-a6c0-46381581add2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.725034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8db78-c023-4ffe-a6c0-46381581add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.725439 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8db78-c023-4ffe-a6c0-46381581add2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.725671 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f28e87-ca72-487f-a64a-925bd2c5af48 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.726737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8db78-c023-4ffe-a6c0-46381581add2 admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=20f42eb51a824f69a6f77c5044300da2) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.727289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8db78-c023-4ffe-a6c0-46381581add2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.729956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8db78-c023-4ffe-a6c0-46381581add2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.730878 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf3de91-db04-4347-84b0-995be3e456d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.731751 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3de91-db04-4347-84b0-995be3e456d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.732126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3de91-db04-4347-84b0-995be3e456d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.732599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf3de91-db04-4347-84b0-995be3e456d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.733398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3de91-db04-4347-84b0-995be3e456d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.733798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3de91-db04-4347-84b0-995be3e456d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.735645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf3de91-db04-4347-84b0-995be3e456d0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.738163 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 324/639] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/role_assignments?user.id=20f42eb51a824f69a6f77c5044300da2&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:21.753323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40d6b-ffff-4a25-b292-3c0a7a328412 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.753948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40d6b-ffff-4a25-b292-3c0a7a328412 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.754398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de40d6b-ffff-4a25-b292-3c0a7a328412 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.757232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 325/640] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:21.757392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 316/641] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:21.763867 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9c051-2f24-4c2c-a65a-66b808234c8f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.764163 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9c051-2f24-4c2c-a65a-66b808234c8f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.764420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9c051-2f24-4c2c-a65a-66b808234c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.765943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40d6b-ffff-4a25-b292-3c0a7a328412 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.779864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de40d6b-ffff-4a25-b292-3c0a7a328412 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.785239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12c5a4-d4f3-4d88-9686-de6eecccaf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.786565 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-eba9c051-2f24-4c2c-a65a-66b808234c8f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:21.786809 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12c5a4-d4f3-4d88-9686-de6eecccaf4e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.787326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12c5a4-d4f3-4d88-9686-de6eecccaf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.787780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-eba9c051-2f24-4c2c-a65a-66b808234c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:21.788142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12c5a4-d4f3-4d88-9686-de6eecccaf4e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.800902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 317/642] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:21.802438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12c5a4-d4f3-4d88-9686-de6eecccaf4e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.802572 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044f249-c911-46df-8059-a3f75d173e48 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.802733 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044f249-c911-46df-8059-a3f75d173e48 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.803002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7044f249-c911-46df-8059-a3f75d173e48 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.805298 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 318/643] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:21.806127 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12c5a4-d4f3-4d88-9686-de6eecccaf4e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.811842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a05843-871c-4edf-9718-bf7717d01e13 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.812143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a05843-871c-4edf-9718-bf7717d01e13 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.812447 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a05843-871c-4edf-9718-bf7717d01e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.822778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-0b12c5a4-d4f3-4d88-9686-de6eecccaf4e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 13 16:36:21.824697 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 326/644] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:21.825692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12c5a4-d4f3-4d88-9686-de6eecccaf4e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.832462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-68a05843-871c-4edf-9718-bf7717d01e13 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:21.833710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-68a05843-871c-4edf-9718-bf7717d01e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:21.838964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12c5a4-d4f3-4d88-9686-de6eecccaf4e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.844113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80446b-456b-46dd-9381-36fcdd4e3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.844917 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80446b-456b-46dd-9381-36fcdd4e3db2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.845195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80446b-456b-46dd-9381-36fcdd4e3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.845467 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80446b-456b-46dd-9381-36fcdd4e3db2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.848653 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 319/645] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:21 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:36:21.849786 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a05843-871c-4edf-9718-bf7717d01e13 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.858520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80446b-456b-46dd-9381-36fcdd4e3db2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:21.862157 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a05843-871c-4edf-9718-bf7717d01e13 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.865998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-eb80446b-456b-46dd-9381-36fcdd4e3db2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:21.867117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ec657-3983-451f-8bc0-1604eadab8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.867661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 327/646] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:21.868142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ec657-3983-451f-8bc0-1604eadab8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.868600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ec657-3983-451f-8bc0-1604eadab8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.869051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ec657-3983-451f-8bc0-1604eadab8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.869745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ec657-3983-451f-8bc0-1604eadab8d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.870055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ec657-3983-451f-8bc0-1604eadab8d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.870499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80446b-456b-46dd-9381-36fcdd4e3db2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.871946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ec657-3983-451f-8bc0-1604eadab8d3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.881656 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80446b-456b-46dd-9381-36fcdd4e3db2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.886622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a67ad-0389-47e3-844a-ce58d2a3a47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.887442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a67ad-0389-47e3-844a-ce58d2a3a47e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.887726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a67ad-0389-47e3-844a-ce58d2a3a47e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.888001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a67ad-0389-47e3-844a-ce58d2a3a47e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.895092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 320/647] 10.222.0.62 () {56 vars in 1154 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:21.895985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ec657-3983-451f-8bc0-1604eadab8d3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.900477 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a67ad-0389-47e3-844a-ce58d2a3a47e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:21.906862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ec657-3983-451f-8bc0-1604eadab8d3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.907856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-696a67ad-0389-47e3-844a-ce58d2a3a47e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:21.911460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884c049-a7bb-4a5c-8330-a9aa63526a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.912223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884c049-a7bb-4a5c-8330-a9aa63526a53 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.912597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884c049-a7bb-4a5c-8330-a9aa63526a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.912936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884c049-a7bb-4a5c-8330-a9aa63526a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.913873 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884c049-a7bb-4a5c-8330-a9aa63526a53 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.914253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884c049-a7bb-4a5c-8330-a9aa63526a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.914764 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 328/648] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:21.915849 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a67ad-0389-47e3-844a-ce58d2a3a47e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.916099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b884c049-a7bb-4a5c-8330-a9aa63526a53 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.928722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a67ad-0389-47e3-844a-ce58d2a3a47e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.929003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 321/649] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:21.930139 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884c049-a7bb-4a5c-8330-a9aa63526a53 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.940554 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c44bb-445d-45ac-9cd2-04b16a4bfb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.941242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c44bb-445d-45ac-9cd2-04b16a4bfb63 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.941520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c44bb-445d-45ac-9cd2-04b16a4bfb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.941790 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c44bb-445d-45ac-9cd2-04b16a4bfb63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.946208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884c049-a7bb-4a5c-8330-a9aa63526a53 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.952353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c6f90-93ec-4c48-a4e3-f74fcff9e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.953218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c6f90-93ec-4c48-a4e3-f74fcff9e73f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.953571 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c6f90-93ec-4c48-a4e3-f74fcff9e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.953918 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c6f90-93ec-4c48-a4e3-f74fcff9e73f admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.954213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c44bb-445d-45ac-9cd2-04b16a4bfb63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.954815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c6f90-93ec-4c48-a4e3-f74fcff9e73f admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:21.955183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c6f90-93ec-4c48-a4e3-f74fcff9e73f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:21.956538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312c44bb-445d-45ac-9cd2-04b16a4bfb63 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.956943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c6f90-93ec-4c48-a4e3-f74fcff9e73f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:21.968906 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 329/651] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:21.969616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 322/651] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:21.970455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c44bb-445d-45ac-9cd2-04b16a4bfb63 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.972892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c6f90-93ec-4c48-a4e3-f74fcff9e73f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:21.982184 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312c44bb-445d-45ac-9cd2-04b16a4bfb63 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.983054 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c6f90-93ec-4c48-a4e3-f74fcff9e73f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:21.987552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21116035-9ab3-4074-8a6d-65e287bd4be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.987882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6176999-160e-43b4-9896-132f7228c096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:21.988478 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21116035-9ab3-4074-8a6d-65e287bd4be3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.988860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21116035-9ab3-4074-8a6d-65e287bd4be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.989202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21116035-9ab3-4074-8a6d-65e287bd4be3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:21.989456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6176999-160e-43b4-9896-132f7228c096 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:21.989951 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6176999-160e-43b4-9896-132f7228c096 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:21.990455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6176999-160e-43b4-9896-132f7228c096 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.002465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21116035-9ab3-4074-8a6d-65e287bd4be3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.003356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21116035-9ab3-4074-8a6d-65e287bd4be3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.003714 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6176999-160e-43b4-9896-132f7228c096 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.005887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6176999-160e-43b4-9896-132f7228c096 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.024536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-c6176999-160e-43b4-9896-132f7228c096 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:22.025368 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-21116035-9ab3-4074-8a6d-65e287bd4be3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:22.026370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 330/652] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:22.026715 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 323/653] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:22.029278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6176999-160e-43b4-9896-132f7228c096 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.033398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21116035-9ab3-4074-8a6d-65e287bd4be3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.040023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6176999-160e-43b4-9896-132f7228c096 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.045468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21116035-9ab3-4074-8a6d-65e287bd4be3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.045923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebbf06-9f41-4f0b-b6e1-e50bea74e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.046877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebbf06-9f41-4f0b-b6e1-e50bea74e1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.047154 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebbf06-9f41-4f0b-b6e1-e50bea74e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.047508 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebbf06-9f41-4f0b-b6e1-e50bea74e1e5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.050394 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f637d77-2d0d-4e37-b79b-35840f8493a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.051508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f637d77-2d0d-4e37-b79b-35840f8493a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.051859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f637d77-2d0d-4e37-b79b-35840f8493a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.052195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f637d77-2d0d-4e37-b79b-35840f8493a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.053052 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f637d77-2d0d-4e37-b79b-35840f8493a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.053419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f637d77-2d0d-4e37-b79b-35840f8493a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.055166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f637d77-2d0d-4e37-b79b-35840f8493a0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.059239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebbf06-9f41-4f0b-b6e1-e50bea74e1e5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.061579 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebbf06-9f41-4f0b-b6e1-e50bea74e1e5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.069626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 324/654] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:22.071096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f637d77-2d0d-4e37-b79b-35840f8493a0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.080909 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-25ebbf06-9f41-4f0b-b6e1-e50bea74e1e5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:22.081680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f637d77-2d0d-4e37-b79b-35840f8493a0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.082457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 331/655] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:22.083217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebbf06-9f41-4f0b-b6e1-e50bea74e1e5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.096921 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3666e7-2322-4064-8cf8-932a3fbb22f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.097823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3666e7-2322-4064-8cf8-932a3fbb22f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.098109 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3666e7-2322-4064-8cf8-932a3fbb22f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.098383 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3666e7-2322-4064-8cf8-932a3fbb22f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.099134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3666e7-2322-4064-8cf8-932a3fbb22f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.099440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3666e7-2322-4064-8cf8-932a3fbb22f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.100059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebbf06-9f41-4f0b-b6e1-e50bea74e1e5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.101372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3666e7-2322-4064-8cf8-932a3fbb22f1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.108600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bd1b0-de69-4d8d-9d49-b68f9e0b2e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.108600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd1b0-de69-4d8d-9d49-b68f9e0b2e35 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.108600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd1b0-de69-4d8d-9d49-b68f9e0b2e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.108600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500bd1b0-de69-4d8d-9d49-b68f9e0b2e35 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.115248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 325/656] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:22.116232 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3666e7-2322-4064-8cf8-932a3fbb22f1 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.119614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bd1b0-de69-4d8d-9d49-b68f9e0b2e35 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.122079 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500bd1b0-de69-4d8d-9d49-b68f9e0b2e35 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.126207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3666e7-2322-4064-8cf8-932a3fbb22f1 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.130991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d27c1-3f3f-4c7a-ab08-bb37b1d10cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.131642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d27c1-3f3f-4c7a-ab08-bb37b1d10cab admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.131927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d27c1-3f3f-4c7a-ab08-bb37b1d10cab admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.132601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d27c1-3f3f-4c7a-ab08-bb37b1d10cab admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.133415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d27c1-3f3f-4c7a-ab08-bb37b1d10cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.133720 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d27c1-3f3f-4c7a-ab08-bb37b1d10cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.135410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d27c1-3f3f-4c7a-ab08-bb37b1d10cab admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.137345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-500bd1b0-de69-4d8d-9d49-b68f9e0b2e35 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Dec 13 16:36:22.139213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 332/657] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/users/neutron => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:22.140457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bd1b0-de69-4d8d-9d49-b68f9e0b2e35 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.153626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 326/658] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:22.154607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d27c1-3f3f-4c7a-ab08-bb37b1d10cab admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.156836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500bd1b0-de69-4d8d-9d49-b68f9e0b2e35 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.164127 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909efb82-f9fa-4a09-99f7-5a818cf26303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.164946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909efb82-f9fa-4a09-99f7-5a818cf26303 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.165281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909efb82-f9fa-4a09-99f7-5a818cf26303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.165556 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909efb82-f9fa-4a09-99f7-5a818cf26303 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.170467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d27c1-3f3f-4c7a-ab08-bb37b1d10cab admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.174506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909efb82-f9fa-4a09-99f7-5a818cf26303 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.175697 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246069d-1739-47f9-8f30-270dbdcc089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.176356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246069d-1739-47f9-8f30-270dbdcc089b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.176663 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909efb82-f9fa-4a09-99f7-5a818cf26303 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.176764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246069d-1739-47f9-8f30-270dbdcc089b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.176926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4246069d-1739-47f9-8f30-270dbdcc089b admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.177922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246069d-1739-47f9-8f30-270dbdcc089b admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.178218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246069d-1739-47f9-8f30-270dbdcc089b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.180861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4246069d-1739-47f9-8f30-270dbdcc089b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.190895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-909efb82-f9fa-4a09-99f7-5a818cf26303 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 13 16:36:22.192501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 333/659] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/users/swift => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:22.193483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909efb82-f9fa-4a09-99f7-5a818cf26303 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.199316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 327/660] 10.222.0.62 () {56 vars in 1160 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:22.200664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246069d-1739-47f9-8f30-270dbdcc089b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.211001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909efb82-f9fa-4a09-99f7-5a818cf26303 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.216749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4246069d-1739-47f9-8f30-270dbdcc089b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.216936 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b14f2-e7ca-4c88-9567-2e2307dccfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.217668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b14f2-e7ca-4c88-9567-2e2307dccfbf admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.217942 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b14f2-e7ca-4c88-9567-2e2307dccfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.218344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425b14f2-e7ca-4c88-9567-2e2307dccfbf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.221198 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20381d5-244e-48fa-988e-722839a5c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.221859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20381d5-244e-48fa-988e-722839a5c21c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.222135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20381d5-244e-48fa-988e-722839a5c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.222407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20381d5-244e-48fa-988e-722839a5c21c admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.223250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20381d5-244e-48fa-988e-722839a5c21c admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.223554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20381d5-244e-48fa-988e-722839a5c21c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.225442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20381d5-244e-48fa-988e-722839a5c21c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.226378 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b14f2-e7ca-4c88-9567-2e2307dccfbf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.229699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425b14f2-e7ca-4c88-9567-2e2307dccfbf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.244870 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-425b14f2-e7ca-4c88-9567-2e2307dccfbf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:22.246074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 334/661] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:22.249288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b14f2-e7ca-4c88-9567-2e2307dccfbf admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.254373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 328/662] 10.222.0.62 () {56 vars in 1156 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:22.255197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20381d5-244e-48fa-988e-722839a5c21c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.263988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425b14f2-e7ca-4c88-9567-2e2307dccfbf admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.266177 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20381d5-244e-48fa-988e-722839a5c21c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.270783 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7676d-4787-46b1-8ed0-f60b7fe6582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.271239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057689e-7817-43e9-b6c7-3493761f6296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.271475 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7676d-4787-46b1-8ed0-f60b7fe6582a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.271694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7676d-4787-46b1-8ed0-f60b7fe6582a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.271963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7676d-4787-46b1-8ed0-f60b7fe6582a admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.272391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057689e-7817-43e9-b6c7-3493761f6296 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.273198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057689e-7817-43e9-b6c7-3493761f6296 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.273383 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7676d-4787-46b1-8ed0-f60b7fe6582a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.273529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7676d-4787-46b1-8ed0-f60b7fe6582a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.273721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057689e-7817-43e9-b6c7-3493761f6296 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.275626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7676d-4787-46b1-8ed0-f60b7fe6582a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.283410 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057689e-7817-43e9-b6c7-3493761f6296 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.285257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057689e-7817-43e9-b6c7-3493761f6296 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.289173 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 329/663] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:22.290168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7676d-4787-46b1-8ed0-f60b7fe6582a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.294602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 335/664] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:22.300344 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7676d-4787-46b1-8ed0-f60b7fe6582a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.300774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057689e-7817-43e9-b6c7-3493761f6296 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.304765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb341fc-a638-497d-92c2-4446ca38cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.305737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb341fc-a638-497d-92c2-4446ca38cfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.306008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb341fc-a638-497d-92c2-4446ca38cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.306273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb341fc-a638-497d-92c2-4446ca38cfa8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.310053 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057689e-7817-43e9-b6c7-3493761f6296 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.314762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d15f38-2557-4950-bad4-327ada1515ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.315641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15f38-2557-4950-bad4-327ada1515ed admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.316071 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15f38-2557-4950-bad4-327ada1515ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.321298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d15f38-2557-4950-bad4-327ada1515ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.322067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb341fc-a638-497d-92c2-4446ca38cfa8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.322067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb341fc-a638-497d-92c2-4446ca38cfa8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.327559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d15f38-2557-4950-bad4-327ada1515ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.329666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d15f38-2557-4950-bad4-327ada1515ed admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.342201 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-4fb341fc-a638-497d-92c2-4446ca38cfa8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:22.342201 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 330/665] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:22.343375 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb341fc-a638-497d-92c2-4446ca38cfa8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.348746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-c4d15f38-2557-4950-bad4-327ada1515ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:22.350909 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 336/666] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:22.352245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb341fc-a638-497d-92c2-4446ca38cfa8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.354050 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d15f38-2557-4950-bad4-327ada1515ed admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.364004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699c8a6-38ba-453e-8d3e-50c994e1d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.364674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699c8a6-38ba-453e-8d3e-50c994e1d6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.364953 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699c8a6-38ba-453e-8d3e-50c994e1d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.365220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699c8a6-38ba-453e-8d3e-50c994e1d6e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.366058 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699c8a6-38ba-453e-8d3e-50c994e1d6e9 admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=dfecc747eb8d431a8d57f4534d259de8) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.366363 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699c8a6-38ba-453e-8d3e-50c994e1d6e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.368230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1699c8a6-38ba-453e-8d3e-50c994e1d6e9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.372187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d15f38-2557-4950-bad4-327ada1515ed admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.374982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 331/667] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/role_assignments?user.id=dfecc747eb8d431a8d57f4534d259de8&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:22.375800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699c8a6-38ba-453e-8d3e-50c994e1d6e9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.378501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ea0b-635d-45dd-9918-ac1e970473ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.379710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ea0b-635d-45dd-9918-ac1e970473ea admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.380523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ea0b-635d-45dd-9918-ac1e970473ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.381236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2ea0b-635d-45dd-9918-ac1e970473ea admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.383026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2ea0b-635d-45dd-9918-ac1e970473ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.383743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2ea0b-635d-45dd-9918-ac1e970473ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.385925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2ea0b-635d-45dd-9918-ac1e970473ea admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.386510 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699c8a6-38ba-453e-8d3e-50c994e1d6e9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.401092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 337/668] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:22.408729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ea0b-635d-45dd-9918-ac1e970473ea admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.409517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427281e9-afa2-4825-adf7-f52fc666785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.410308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427281e9-afa2-4825-adf7-f52fc666785b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.410688 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427281e9-afa2-4825-adf7-f52fc666785b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.411048 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427281e9-afa2-4825-adf7-f52fc666785b admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.411893 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427281e9-afa2-4825-adf7-f52fc666785b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.412287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427281e9-afa2-4825-adf7-f52fc666785b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.414125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427281e9-afa2-4825-adf7-f52fc666785b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.420778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2ea0b-635d-45dd-9918-ac1e970473ea admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.432288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca9e4c-c6bf-41d9-8ad9-cab3f9852a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.435625 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca9e4c-c6bf-41d9-8ad9-cab3f9852a9f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.436255 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca9e4c-c6bf-41d9-8ad9-cab3f9852a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.438158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca9e4c-c6bf-41d9-8ad9-cab3f9852a9f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.439638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 332/669] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:22.446905 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427281e9-afa2-4825-adf7-f52fc666785b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.455222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca9e4c-c6bf-41d9-8ad9-cab3f9852a9f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.458879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca9e4c-c6bf-41d9-8ad9-cab3f9852a9f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.462270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427281e9-afa2-4825-adf7-f52fc666785b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.474872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f72a2-a863-454f-8883-1de4ef833337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.476427 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f72a2-a863-454f-8883-1de4ef833337 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.476970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f72a2-a863-454f-8883-1de4ef833337 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.477699 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f72a2-a863-454f-8883-1de4ef833337 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.492728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-2fca9e4c-c6bf-41d9-8ad9-cab3f9852a9f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:22.494205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f72a2-a863-454f-8883-1de4ef833337 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.496353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f72a2-a863-454f-8883-1de4ef833337 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.503304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 338/670] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:22.507231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca9e4c-c6bf-41d9-8ad9-cab3f9852a9f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.517999 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca9e4c-c6bf-41d9-8ad9-cab3f9852a9f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.521532 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-cf5f72a2-a863-454f-8883-1de4ef833337 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:22.523056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 333/671] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:22.525520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd20319-bff3-4880-9555-3e3ff59782c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.526396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd20319-bff3-4880-9555-3e3ff59782c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.526799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd20319-bff3-4880-9555-3e3ff59782c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.527259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd20319-bff3-4880-9555-3e3ff59782c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.528311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd20319-bff3-4880-9555-3e3ff59782c0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.528798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd20319-bff3-4880-9555-3e3ff59782c0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.529772 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f72a2-a863-454f-8883-1de4ef833337 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.531071 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd20319-bff3-4880-9555-3e3ff59782c0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.541346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f72a2-a863-454f-8883-1de4ef833337 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.547487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 339/672] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:22.549315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0d53d-d730-4f7c-b11c-f05081742319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.550200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0d53d-d730-4f7c-b11c-f05081742319 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.550626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0d53d-d730-4f7c-b11c-f05081742319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.551068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee0d53d-d730-4f7c-b11c-f05081742319 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.552907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd20319-bff3-4880-9555-3e3ff59782c0 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.556537 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0d53d-d730-4f7c-b11c-f05081742319 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.558093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0d53d-d730-4f7c-b11c-f05081742319 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.561364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee0d53d-d730-4f7c-b11c-f05081742319 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.570305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd20319-bff3-4880-9555-3e3ff59782c0 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.580210 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eaf8a-ec6e-4a7b-986b-6a28b60babd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.582176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaf8a-ec6e-4a7b-986b-6a28b60babd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.583590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaf8a-ec6e-4a7b-986b-6a28b60babd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.586029 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eaf8a-ec6e-4a7b-986b-6a28b60babd2 admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/940c2c607c7b4f949593791360f99fbd/roles/0b0b2f3132974ff2a8a6fb9683036c6e` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.588079 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 334/673] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:22.595756 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0d53d-d730-4f7c-b11c-f05081742319 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:22.610919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee0d53d-d730-4f7c-b11c-f05081742319 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:22.616919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eaf8a-ec6e-4a7b-986b-6a28b60babd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=940c2c607c7b4f949593791360f99fbd, role_id=0b0b2f3132974ff2a8a6fb9683036c6e)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.621509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2791a9f-3028-48d5-ac6d-d94305bde165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:22.623116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791a9f-3028-48d5-ac6d-d94305bde165 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:22.624040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eaf8a-ec6e-4a7b-986b-6a28b60babd2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.624465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791a9f-3028-48d5-ac6d-d94305bde165 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:22.625098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2791a9f-3028-48d5-ac6d-d94305bde165 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:22.628346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2791a9f-3028-48d5-ac6d-d94305bde165 admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=51f9a10e3d87475e92fb49686f1aa456) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:22.628858 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2791a9f-3028-48d5-ac6d-d94305bde165 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:22.631418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2791a9f-3028-48d5-ac6d-d94305bde165 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:22.641096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 335/674] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:22 2021] GET /identity/v3/role_assignments?user.id=51f9a10e3d87475e92fb49686f1aa456&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:22.651115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 340/675] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:36:22 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/940c2c607c7b4f949593791360f99fbd/roles/0b0b2f3132974ff2a8a6fb9683036c6e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:36:24.470141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca5d7-f761-4bc7-b3a6-db5d2bc04028 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:24.470998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca5d7-f761-4bc7-b3a6-db5d2bc04028 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:24.471413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca5d7-f761-4bc7-b3a6-db5d2bc04028 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:24.473389 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 336/676] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:24.480051 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d43f-f2ff-4990-98fe-eec47a65e80c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:24.480486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d43f-f2ff-4990-98fe-eec47a65e80c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:24.480732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d43f-f2ff-4990-98fe-eec47a65e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:24.504225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a6c4d43f-f2ff-4990-98fe-eec47a65e80c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:24.505441 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a6c4d43f-f2ff-4990-98fe-eec47a65e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:24.584979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 341/677] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:24.634751 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca5d7-f761-4bc7-b3a6-db5d2bc04028 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:24.650554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca5d7-f761-4bc7-b3a6-db5d2bc04028 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:24.658918 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77194c-3da5-47ae-852d-0f993a8aa779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:24.659909 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77194c-3da5-47ae-852d-0f993a8aa779 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:24.660328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77194c-3da5-47ae-852d-0f993a8aa779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:24.660770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77194c-3da5-47ae-852d-0f993a8aa779 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:24.680225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77194c-3da5-47ae-852d-0f993a8aa779 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:24.682303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77194c-3da5-47ae-852d-0f993a8aa779 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:24.699738 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-0b77194c-3da5-47ae-852d-0f993a8aa779 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:24.701412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 337/678] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:24.707789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4d43f-f2ff-4990-98fe-eec47a65e80c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:24.717136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4d43f-f2ff-4990-98fe-eec47a65e80c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:24.721655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914fad6-d0fa-4682-a0cd-1fded2899b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:24.722413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914fad6-d0fa-4682-a0cd-1fded2899b8c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:24.722783 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914fad6-d0fa-4682-a0cd-1fded2899b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:24.723146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914fad6-d0fa-4682-a0cd-1fded2899b8c admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:24.724001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914fad6-d0fa-4682-a0cd-1fded2899b8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:24.724393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914fad6-d0fa-4682-a0cd-1fded2899b8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:24.726536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914fad6-d0fa-4682-a0cd-1fded2899b8c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:24.734209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd09b1c-9997-49c2-abca-836b43b48352 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:24.734209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd09b1c-9997-49c2-abca-836b43b48352 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:24.734570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd09b1c-9997-49c2-abca-836b43b48352 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:24.736691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 338/679] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:24.739265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 342/680] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:24.745433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914fad6-d0fa-4682-a0cd-1fded2899b8c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:24.745576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c123e-821d-45fe-89b5-a250580c70ed None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:24.745809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c123e-821d-45fe-89b5-a250580c70ed None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:24.746143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c123e-821d-45fe-89b5-a250580c70ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:24.757622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914fad6-d0fa-4682-a0cd-1fded2899b8c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:24.762242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01468-8eee-487c-8856-b9b8c350eb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:24.762998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01468-8eee-487c-8856-b9b8c350eb9b admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:24.763367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01468-8eee-487c-8856-b9b8c350eb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:24.763913 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b01468-8eee-487c-8856-b9b8c350eb9b admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:24.765995 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b01468-8eee-487c-8856-b9b8c350eb9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:24.767993 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b01468-8eee-487c-8856-b9b8c350eb9b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:24.784395 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-8d3c123e-821d-45fe-89b5-a250580c70ed None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:24.785823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8d3c123e-821d-45fe-89b5-a250580c70ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:24.796551 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 343/681] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:36:24 2021] POST /identity/v3/users => generated 254 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:24.806621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 339/682] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:24 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:36:24.847008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01468-8eee-487c-8856-b9b8c350eb9b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:24.860534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b01468-8eee-487c-8856-b9b8c350eb9b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:24.865238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dba83-78df-4ae5-ba71-7872209b5c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:24.866165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dba83-78df-4ae5-ba71-7872209b5c86 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:24.866600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dba83-78df-4ae5-ba71-7872209b5c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:24.866982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140dba83-78df-4ae5-ba71-7872209b5c86 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:24.867750 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140dba83-78df-4ae5-ba71-7872209b5c86 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:24.868907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-140dba83-78df-4ae5-ba71-7872209b5c86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:24.868907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:36:24.868907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:36:24.870012 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140dba83-78df-4ae5-ba71-7872209b5c86 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:24.884754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-140dba83-78df-4ae5-ba71-7872209b5c86 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 13 16:36:24.886527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 344/683] 10.222.0.62 () {56 vars in 1150 bytes} [Mon Dec 13 16:36:24 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:24.893567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c123e-821d-45fe-89b5-a250580c70ed None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:24.903556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c123e-821d-45fe-89b5-a250580c70ed None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:24.912510 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace2b15-1e37-4033-83ca-e524974b2886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:24.913431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2b15-1e37-4033-83ca-e524974b2886 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:24.913874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2b15-1e37-4033-83ca-e524974b2886 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:24.914262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace2b15-1e37-4033-83ca-e524974b2886 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:24.915177 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace2b15-1e37-4033-83ca-e524974b2886 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:24.915576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace2b15-1e37-4033-83ca-e524974b2886 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:24.916745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-9ace2b15-1e37-4033-83ca-e524974b2886 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:24.916745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:36:24.916745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:36:24.917850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace2b15-1e37-4033-83ca-e524974b2886 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:24.923591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 340/684] 10.222.0.62 () {56 vars in 1145 bytes} [Mon Dec 13 16:36:24 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:24.930023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dba83-78df-4ae5-ba71-7872209b5c86 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:24.955424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140dba83-78df-4ae5-ba71-7872209b5c86 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:24.963522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30cd69-4b42-437e-b0d1-7deff92098cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:24.964491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30cd69-4b42-437e-b0d1-7deff92098cc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:24.964950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30cd69-4b42-437e-b0d1-7deff92098cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:24.965409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30cd69-4b42-437e-b0d1-7deff92098cc admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:24.966343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30cd69-4b42-437e-b0d1-7deff92098cc admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:24.966838 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30cd69-4b42-437e-b0d1-7deff92098cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:24.968083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-3d30cd69-4b42-437e-b0d1-7deff92098cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:24.968083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:36:24.968083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:36:24.969433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30cd69-4b42-437e-b0d1-7deff92098cc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:24.982122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 345/685] 10.222.0.62 () {56 vars in 1145 bytes} [Mon Dec 13 16:36:24 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:25.445987 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea75244-1d4c-4785-ad5f-e667db8dad3e None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.446481 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea75244-1d4c-4785-ad5f-e667db8dad3e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.446856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea75244-1d4c-4785-ad5f-e667db8dad3e None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.449017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 341/686] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:25.455154 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9a2e6-04f0-42b2-af55-02623df2f33c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.455445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9a2e6-04f0-42b2-af55-02623df2f33c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.455719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9a2e6-04f0-42b2-af55-02623df2f33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.478463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-76a9a2e6-04f0-42b2-af55-02623df2f33c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:25.479674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-76a9a2e6-04f0-42b2-af55-02623df2f33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:25.491234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 346/687] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:25.516220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea75244-1d4c-4785-ad5f-e667db8dad3e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:25.537681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea75244-1d4c-4785-ad5f-e667db8dad3e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:25.543288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327764fc-7b57-4bdc-8c7d-e4802e551d27 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.543577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327764fc-7b57-4bdc-8c7d-e4802e551d27 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.543854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327764fc-7b57-4bdc-8c7d-e4802e551d27 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.545293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944099b-b01c-4e2a-bf39-d9b7e49eb060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:25.545926 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 347/688] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:25.546626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944099b-b01c-4e2a-bf39-d9b7e49eb060 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.547094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944099b-b01c-4e2a-bf39-d9b7e49eb060 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.547546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944099b-b01c-4e2a-bf39-d9b7e49eb060 admin admin] PATH_INFO: `/v3/services/network` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.548399 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944099b-b01c-4e2a-bf39-d9b7e49eb060 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:25.549784 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-4944099b-b01c-4e2a-bf39-d9b7e49eb060 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:25.549784 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:36:25.549784 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:36:25.550986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944099b-b01c-4e2a-bf39-d9b7e49eb060 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:25.557838 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea177a2-ea2e-42ac-ac1a-bda7fd8f053c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.558123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea177a2-ea2e-42ac-ac1a-bda7fd8f053c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.558396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea177a2-ea2e-42ac-ac1a-bda7fd8f053c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.569975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-4944099b-b01c-4e2a-bf39-d9b7e49eb060 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 13 16:36:25.577056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 342/689] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:25 2021] GET /identity/v3/services/network => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:25.578136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944099b-b01c-4e2a-bf39-d9b7e49eb060 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:25.588231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944099b-b01c-4e2a-bf39-d9b7e49eb060 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:25.596603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-6ea177a2-ea2e-42ac-ac1a-bda7fd8f053c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:25.596603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6ea177a2-ea2e-42ac-ac1a-bda7fd8f053c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:25.598548 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcf8c9-c379-416c-82b2-02f3c28267f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:25.599244 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcf8c9-c379-416c-82b2-02f3c28267f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.599528 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcf8c9-c379-416c-82b2-02f3c28267f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.599801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcf8c9-c379-416c-82b2-02f3c28267f9 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.600534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcf8c9-c379-416c-82b2-02f3c28267f9 admin admin] RBAC: Adding query filter params (name=network) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:25.600896 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcf8c9-c379-416c-82b2-02f3c28267f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:25.602523 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcf8c9-c379-416c-82b2-02f3c28267f9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:25.607925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 343/690] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:25 2021] GET /identity/v3/services?name=network => generated 124 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:25.613626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcf8c9-c379-416c-82b2-02f3c28267f9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:25.614717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 348/691] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:36:25.623461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcf8c9-c379-416c-82b2-02f3c28267f9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:25.628091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c799ab-732b-4b4a-ba96-79da36fd0796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:25.628812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c799ab-732b-4b4a-ba96-79da36fd0796 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.629104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c799ab-732b-4b4a-ba96-79da36fd0796 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.629379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c799ab-732b-4b4a-ba96-79da36fd0796 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.630200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c799ab-732b-4b4a-ba96-79da36fd0796 admin admin] RBAC: Adding query filter params (type=network) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:25.630504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c799ab-732b-4b4a-ba96-79da36fd0796 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:25.632276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c799ab-732b-4b4a-ba96-79da36fd0796 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:25.638303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 344/692] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:25 2021] GET /identity/v3/services?type=network => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:25.649441 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea177a2-ea2e-42ac-ac1a-bda7fd8f053c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:25.663622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea177a2-ea2e-42ac-ac1a-bda7fd8f053c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:25.678488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090d357-5886-4165-8a87-9c6b54b14f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:25.679436 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090d357-5886-4165-8a87-9c6b54b14f27 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.679722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090d357-5886-4165-8a87-9c6b54b14f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.679999 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090d357-5886-4165-8a87-9c6b54b14f27 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.702853 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090d357-5886-4165-8a87-9c6b54b14f27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:25.710032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-a090d357-5886-4165-8a87-9c6b54b14f27 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:25.716890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 349/693] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:25.719099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c799ab-732b-4b4a-ba96-79da36fd0796 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:25.735513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c799ab-732b-4b4a-ba96-79da36fd0796 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:25.746543 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454d07d-d2a7-4a91-b712-c27c0a56b41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:25.747291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454d07d-d2a7-4a91-b712-c27c0a56b41f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.747576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454d07d-d2a7-4a91-b712-c27c0a56b41f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.747900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454d07d-d2a7-4a91-b712-c27c0a56b41f admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.748706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454d07d-d2a7-4a91-b712-c27c0a56b41f admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:25.749012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454d07d-d2a7-4a91-b712-c27c0a56b41f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:25.750726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454d07d-d2a7-4a91-b712-c27c0a56b41f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:25.768676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 345/694] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:25.774893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090d357-5886-4165-8a87-9c6b54b14f27 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:25.789779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090d357-5886-4165-8a87-9c6b54b14f27 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:25.792658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a748-705e-4d4a-a2a9-55b756fe2dbe None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.793030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a748-705e-4d4a-a2a9-55b756fe2dbe None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.793307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150a748-705e-4d4a-a2a9-55b756fe2dbe None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.794670 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd901e8e-6cac-40cc-a1c1-25c3d331cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:25.795492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 346/695] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:25.796764 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd901e8e-6cac-40cc-a1c1-25c3d331cd39 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.797081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd901e8e-6cac-40cc-a1c1-25c3d331cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.797364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd901e8e-6cac-40cc-a1c1-25c3d331cd39 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.812519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd901e8e-6cac-40cc-a1c1-25c3d331cd39 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:25.814432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd901e8e-6cac-40cc-a1c1-25c3d331cd39 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:25.817773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358862c-7716-4cbf-9549-56873224ae7a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.818062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358862c-7716-4cbf-9549-56873224ae7a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.818338 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358862c-7716-4cbf-9549-56873224ae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.833966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-cd901e8e-6cac-40cc-a1c1-25c3d331cd39 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:25.835710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 350/696] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:25.845112 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd901e8e-6cac-40cc-a1c1-25c3d331cd39 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:25.852343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-0358862c-7716-4cbf-9549-56873224ae7a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:25.855365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0358862c-7716-4cbf-9549-56873224ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:25.867289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd901e8e-6cac-40cc-a1c1-25c3d331cd39 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:25.871735 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 347/697] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:25 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Dec 13 16:36:25.880046 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53535352-8a1c-4a58-8d9f-73d20d09ded2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:25.880847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535352-8a1c-4a58-8d9f-73d20d09ded2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.881179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535352-8a1c-4a58-8d9f-73d20d09ded2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.881454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53535352-8a1c-4a58-8d9f-73d20d09ded2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.882347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53535352-8a1c-4a58-8d9f-73d20d09ded2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:25.882719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53535352-8a1c-4a58-8d9f-73d20d09ded2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:25.884449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53535352-8a1c-4a58-8d9f-73d20d09ded2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:25.897388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358862c-7716-4cbf-9549-56873224ae7a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:25.904282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 351/698] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:25.910980 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53535352-8a1c-4a58-8d9f-73d20d09ded2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:25.915523 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358862c-7716-4cbf-9549-56873224ae7a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:25.921819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53535352-8a1c-4a58-8d9f-73d20d09ded2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:25.922706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e1fb-7ca3-4a84-85c5-58a01cdddc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:25.923839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e1fb-7ca3-4a84-85c5-58a01cdddc5e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.924346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e1fb-7ca3-4a84-85c5-58a01cdddc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.924901 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964e1fb-7ca3-4a84-85c5-58a01cdddc5e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.926473 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67616d52-9412-4e6d-9a5f-e13c7959ce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:25.927251 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67616d52-9412-4e6d-9a5f-e13c7959ce82 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.927650 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67616d52-9412-4e6d-9a5f-e13c7959ce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.927856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67616d52-9412-4e6d-9a5f-e13c7959ce82 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.936335 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67616d52-9412-4e6d-9a5f-e13c7959ce82 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:25.938389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67616d52-9412-4e6d-9a5f-e13c7959ce82 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:25.939810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a964e1fb-7ca3-4a84-85c5-58a01cdddc5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:25.948366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a964e1fb-7ca3-4a84-85c5-58a01cdddc5e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:36:25.955365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 348/699] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:25.955579 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-67616d52-9412-4e6d-9a5f-e13c7959ce82 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 13 16:36:25.957061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e1fb-7ca3-4a84-85c5-58a01cdddc5e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:25.957168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 352/700] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:25 2021] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:25.968793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964e1fb-7ca3-4a84-85c5-58a01cdddc5e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:25.972312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67616d52-9412-4e6d-9a5f-e13c7959ce82 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:25.976197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a1be0-c96f-4d87-ac73-9c7626c7da5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:25.977235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1be0-c96f-4d87-ac73-9c7626c7da5f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.978003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1be0-c96f-4d87-ac73-9c7626c7da5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.978473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1be0-c96f-4d87-ac73-9c7626c7da5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.980175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a1be0-c96f-4d87-ac73-9c7626c7da5f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:25.980710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a1be0-c96f-4d87-ac73-9c7626c7da5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:25.982608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a1be0-c96f-4d87-ac73-9c7626c7da5f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:25.982715 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67616d52-9412-4e6d-9a5f-e13c7959ce82 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:25.987113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93dde4-295c-4528-bef3-28faf1671b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:25.987798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93dde4-295c-4528-bef3-28faf1671b6a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:25.988075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93dde4-295c-4528-bef3-28faf1671b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:25.988353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93dde4-295c-4528-bef3-28faf1671b6a admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:25.989237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93dde4-295c-4528-bef3-28faf1671b6a admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:25.989543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93dde4-295c-4528-bef3-28faf1671b6a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:25.996594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a93dde4-295c-4528-bef3-28faf1671b6a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.000760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 349/701] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:26.014700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a1be0-c96f-4d87-ac73-9c7626c7da5f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.015628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 353/702] 10.222.0.62 () {56 vars in 1156 bytes} [Mon Dec 13 16:36:25 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:26.025882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93dde4-295c-4528-bef3-28faf1671b6a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.037867 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a1be0-c96f-4d87-ac73-9c7626c7da5f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.040548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93dde4-295c-4528-bef3-28faf1671b6a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.047236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f66d0-78fb-4f39-b496-51640f322200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.047892 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f66d0-78fb-4f39-b496-51640f322200 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.048173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f66d0-78fb-4f39-b496-51640f322200 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.048449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f66d0-78fb-4f39-b496-51640f322200 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.050214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a25b29-72df-46e8-8e6c-0fd854511ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.051009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a25b29-72df-46e8-8e6c-0fd854511ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.051287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a25b29-72df-46e8-8e6c-0fd854511ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.051562 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a25b29-72df-46e8-8e6c-0fd854511ff3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.066515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f66d0-78fb-4f39-b496-51640f322200 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.069825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f66d0-78fb-4f39-b496-51640f322200 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.076215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a25b29-72df-46e8-8e6c-0fd854511ff3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.078110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a25b29-72df-46e8-8e6c-0fd854511ff3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.088282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 354/703] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:36:26.095995 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f66d0-78fb-4f39-b496-51640f322200 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.105322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f66d0-78fb-4f39-b496-51640f322200 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.107582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-97a25b29-72df-46e8-8e6c-0fd854511ff3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:26.109082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 350/704] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:26.115303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a25b29-72df-46e8-8e6c-0fd854511ff3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.121319 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a19bf4-6529-41c4-b87f-9822e76bb7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.122136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a19bf4-6529-41c4-b87f-9822e76bb7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.122871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a19bf4-6529-41c4-b87f-9822e76bb7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.122871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a19bf4-6529-41c4-b87f-9822e76bb7d6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.126515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a25b29-72df-46e8-8e6c-0fd854511ff3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.131461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7e10d-8642-464a-b9c5-d270e14a29b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.132670 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7e10d-8642-464a-b9c5-d270e14a29b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.133386 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7e10d-8642-464a-b9c5-d270e14a29b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.134093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c7e10d-8642-464a-b9c5-d270e14a29b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.135275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7e10d-8642-464a-b9c5-d270e14a29b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:26.135782 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7e10d-8642-464a-b9c5-d270e14a29b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.137627 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c7e10d-8642-464a-b9c5-d270e14a29b9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.149830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a19bf4-6529-41c4-b87f-9822e76bb7d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.155709 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a19bf4-6529-41c4-b87f-9822e76bb7d6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.155980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 351/705] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:26.157544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7e10d-8642-464a-b9c5-d270e14a29b9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.167460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c7e10d-8642-464a-b9c5-d270e14a29b9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.172310 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116ce4e-8db6-42dc-90d3-2c0c68dbfbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.173392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116ce4e-8db6-42dc-90d3-2c0c68dbfbdb admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.173934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116ce4e-8db6-42dc-90d3-2c0c68dbfbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.174401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116ce4e-8db6-42dc-90d3-2c0c68dbfbdb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.182783 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-62a19bf4-6529-41c4-b87f-9822e76bb7d6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:26.184520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116ce4e-8db6-42dc-90d3-2c0c68dbfbdb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.186795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116ce4e-8db6-42dc-90d3-2c0c68dbfbdb admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.188706 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 355/706] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:26.198865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a19bf4-6529-41c4-b87f-9822e76bb7d6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.216245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a19bf4-6529-41c4-b87f-9822e76bb7d6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.220165 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-e116ce4e-8db6-42dc-90d3-2c0c68dbfbdb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 13 16:36:26.220165 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 352/707] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/users/nova => generated 82 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:26.226002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116ce4e-8db6-42dc-90d3-2c0c68dbfbdb admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.229475 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037dbd8-8f63-4bac-88b8-1888c95d3c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.230447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037dbd8-8f63-4bac-88b8-1888c95d3c8a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.230931 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037dbd8-8f63-4bac-88b8-1888c95d3c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.231454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037dbd8-8f63-4bac-88b8-1888c95d3c8a admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.232383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037dbd8-8f63-4bac-88b8-1888c95d3c8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:26.232938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037dbd8-8f63-4bac-88b8-1888c95d3c8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.234835 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037dbd8-8f63-4bac-88b8-1888c95d3c8a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.240587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116ce4e-8db6-42dc-90d3-2c0c68dbfbdb admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.241335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c6770-37f1-40d6-a4ef-740442986abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.242545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6770-37f1-40d6-a4ef-740442986abc admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.242545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6770-37f1-40d6-a4ef-740442986abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.242716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c6770-37f1-40d6-a4ef-740442986abc admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.243507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6770-37f1-40d6-a4ef-740442986abc admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:26.243812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6770-37f1-40d6-a4ef-740442986abc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.245669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c6770-37f1-40d6-a4ef-740442986abc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.258410 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 356/708] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:26.264243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037dbd8-8f63-4bac-88b8-1888c95d3c8a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.264797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 353/709] 10.222.0.62 () {56 vars in 1154 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:26.271090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c6770-37f1-40d6-a4ef-740442986abc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.281171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c6770-37f1-40d6-a4ef-740442986abc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.281727 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037dbd8-8f63-4bac-88b8-1888c95d3c8a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.285640 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9e5a0-9455-45d5-9bc5-fd1b467fc0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.286295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9e5a0-9455-45d5-9bc5-fd1b467fc0fb admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.286577 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9e5a0-9455-45d5-9bc5-fd1b467fc0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.286851 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9e5a0-9455-45d5-9bc5-fd1b467fc0fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.297932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9e5a0-9455-45d5-9bc5-fd1b467fc0fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.299692 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9e5a0-9455-45d5-9bc5-fd1b467fc0fb admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.306570 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ab6b5-77b5-4048-982d-5ba72768be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.307633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ab6b5-77b5-4048-982d-5ba72768be9c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.308099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ab6b5-77b5-4048-982d-5ba72768be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.308457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ab6b5-77b5-4048-982d-5ba72768be9c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.309604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 354/710] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 13 16:36:26.315559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9e5a0-9455-45d5-9bc5-fd1b467fc0fb admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.321424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ab6b5-77b5-4048-982d-5ba72768be9c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.323352 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ab6b5-77b5-4048-982d-5ba72768be9c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.329705 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9e5a0-9455-45d5-9bc5-fd1b467fc0fb admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.339938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de5ac5-a8fd-4d1e-977c-0def878a7b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.340687 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de5ac5-a8fd-4d1e-977c-0def878a7b08 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.340966 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de5ac5-a8fd-4d1e-977c-0def878a7b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.341240 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de5ac5-a8fd-4d1e-977c-0def878a7b08 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.350593 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-e84ab6b5-77b5-4048-982d-5ba72768be9c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:26.351942 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 357/711] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:26.357250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de5ac5-a8fd-4d1e-977c-0def878a7b08 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.357250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de5ac5-a8fd-4d1e-977c-0def878a7b08 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.358350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ab6b5-77b5-4048-982d-5ba72768be9c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.378061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-38de5ac5-a8fd-4d1e-977c-0def878a7b08 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:26.378061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 355/712] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:26.379143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ab6b5-77b5-4048-982d-5ba72768be9c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.379741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de5ac5-a8fd-4d1e-977c-0def878a7b08 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.391993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de5ac5-a8fd-4d1e-977c-0def878a7b08 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.393005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7847d-fd36-4d98-b9b4-a1281f87cd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.393859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7847d-fd36-4d98-b9b4-a1281f87cd00 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.394311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7847d-fd36-4d98-b9b4-a1281f87cd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.394748 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7847d-fd36-4d98-b9b4-a1281f87cd00 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.395720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7847d-fd36-4d98-b9b4-a1281f87cd00 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:26.396182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7847d-fd36-4d98-b9b4-a1281f87cd00 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.397426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906af15-29d0-48a9-82a4-b9e76a20f0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.398521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906af15-29d0-48a9-82a4-b9e76a20f0d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.398817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7847d-fd36-4d98-b9b4-a1281f87cd00 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.399060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906af15-29d0-48a9-82a4-b9e76a20f0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.399445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906af15-29d0-48a9-82a4-b9e76a20f0d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.400302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906af15-29d0-48a9-82a4-b9e76a20f0d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:26.400700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906af15-29d0-48a9-82a4-b9e76a20f0d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.402785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906af15-29d0-48a9-82a4-b9e76a20f0d0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.420057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 356/713] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:26.421150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 358/714] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:26.424593 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906af15-29d0-48a9-82a4-b9e76a20f0d0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.427092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7847d-fd36-4d98-b9b4-a1281f87cd00 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.432022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906af15-29d0-48a9-82a4-b9e76a20f0d0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.436748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa88c2-6cff-422f-8d86-7f663870cc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.437609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa88c2-6cff-422f-8d86-7f663870cc8c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.437987 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa88c2-6cff-422f-8d86-7f663870cc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.438634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa88c2-6cff-422f-8d86-7f663870cc8c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.448591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7847d-fd36-4d98-b9b4-a1281f87cd00 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.448746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa88c2-6cff-422f-8d86-7f663870cc8c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.448746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa88c2-6cff-422f-8d86-7f663870cc8c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.458850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6ac73-56f1-427b-9145-e260ef7f75fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.459829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6ac73-56f1-427b-9145-e260ef7f75fe admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.460469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6ac73-56f1-427b-9145-e260ef7f75fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.460985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6ac73-56f1-427b-9145-e260ef7f75fe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.462073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6ac73-56f1-427b-9145-e260ef7f75fe admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=940c2c607c7b4f949593791360f99fbd) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:26.462538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6ac73-56f1-427b-9145-e260ef7f75fe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.464401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-eeaa88c2-6cff-422f-8d86-7f663870cc8c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:26.464820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6ac73-56f1-427b-9145-e260ef7f75fe admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.472815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 357/715] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:26.473420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa88c2-6cff-422f-8d86-7f663870cc8c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.483511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa88c2-6cff-422f-8d86-7f663870cc8c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.488100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac1f9-6453-449c-9171-6a1b834a7596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.488897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac1f9-6453-449c-9171-6a1b834a7596 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.489182 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac1f9-6453-449c-9171-6a1b834a7596 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.489460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac1f9-6453-449c-9171-6a1b834a7596 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.490365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac1f9-6453-449c-9171-6a1b834a7596 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:26.490574 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 359/716] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/role_assignments?user.id=940c2c607c7b4f949593791360f99fbd&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 608 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:26.490687 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac1f9-6453-449c-9171-6a1b834a7596 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.492951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac1f9-6453-449c-9171-6a1b834a7596 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.506273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 358/717] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:26.513733 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6ac73-56f1-427b-9145-e260ef7f75fe admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:26.526566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6ac73-56f1-427b-9145-e260ef7f75fe admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:26.533983 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661fa779-6972-4cbf-80ba-9826391680b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:26.534895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fa779-6972-4cbf-80ba-9826391680b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:26.535387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fa779-6972-4cbf-80ba-9826391680b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:26.535833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661fa779-6972-4cbf-80ba-9826391680b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:26.536921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fa779-6972-4cbf-80ba-9826391680b0 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=dfecc747eb8d431a8d57f4534d259de8) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:26.537429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fa779-6972-4cbf-80ba-9826391680b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:26.539764 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661fa779-6972-4cbf-80ba-9826391680b0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:26.549864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 360/718] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:26 2021] GET /identity/v3/role_assignments?user.id=dfecc747eb8d431a8d57f4534d259de8&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=f3311ba27a464113b884aa5a1144945d => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:27.760870 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b1272-9bdd-4321-9bce-d0221070210a None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:27.761433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b1272-9bdd-4321-9bce-d0221070210a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:27.761433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b1272-9bdd-4321-9bce-d0221070210a None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:27.763430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 359/719] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:27.769827 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeca76-523b-47c1-a21b-7b2a55d75b77 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:27.770641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeca76-523b-47c1-a21b-7b2a55d75b77 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:27.771128 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebeca76-523b-47c1-a21b-7b2a55d75b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:27.774773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be45cd8-fd4a-4c63-ac95-0e67471c40ed None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:27.775048 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be45cd8-fd4a-4c63-ac95-0e67471c40ed None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:27.775320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be45cd8-fd4a-4c63-ac95-0e67471c40ed None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:27.777142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 360/720] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:27.782780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17401868-ac40-4061-a6dc-f9f4d1118949 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:27.783284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17401868-ac40-4061-a6dc-f9f4d1118949 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:27.783758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17401868-ac40-4061-a6dc-f9f4d1118949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:27.796845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-eebeca76-523b-47c1-a21b-7b2a55d75b77 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:27.798023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-eebeca76-523b-47c1-a21b-7b2a55d75b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:27.808601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 361/721] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:27.817536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-17401868-ac40-4061-a6dc-f9f4d1118949 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:27.818977 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-17401868-ac40-4061-a6dc-f9f4d1118949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:27.831026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 361/722] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Dec 13 16:36:27.858643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebeca76-523b-47c1-a21b-7b2a55d75b77 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:27.868053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17401868-ac40-4061-a6dc-f9f4d1118949 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:27.871923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebeca76-523b-47c1-a21b-7b2a55d75b77 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:27.878542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17401868-ac40-4061-a6dc-f9f4d1118949 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:27.882717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831e601-058e-4aa2-b551-af6c17581883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:27.883811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831e601-058e-4aa2-b551-af6c17581883 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:27.884333 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831e601-058e-4aa2-b551-af6c17581883 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:27.884855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831e601-058e-4aa2-b551-af6c17581883 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:27.892607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518ac38-93f9-4078-a96c-54003a6b7391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:27.892607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518ac38-93f9-4078-a96c-54003a6b7391 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:27.892607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518ac38-93f9-4078-a96c-54003a6b7391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:27.892607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518ac38-93f9-4078-a96c-54003a6b7391 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:27.892950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518ac38-93f9-4078-a96c-54003a6b7391 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:27.892950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-3518ac38-93f9-4078-a96c-54003a6b7391 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:27.892950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:36:27.892950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:36:27.893178 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518ac38-93f9-4078-a96c-54003a6b7391 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:27.906964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7831e601-058e-4aa2-b551-af6c17581883 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:27.916477 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-7831e601-058e-4aa2-b551-af6c17581883 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:27.921658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 362/723] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:36:27 2021] POST /identity/v3/services => generated 251 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:27.922857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 362/724] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:27.929989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518ac38-93f9-4078-a96c-54003a6b7391 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:27.960759 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518ac38-93f9-4078-a96c-54003a6b7391 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:27.968595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbfc3d-8956-4b36-bdac-dfb75b992291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:27.969296 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbfc3d-8956-4b36-bdac-dfb75b992291 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:27.969576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbfc3d-8956-4b36-bdac-dfb75b992291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:27.969851 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbfc3d-8956-4b36-bdac-dfb75b992291 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:27.970630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbfc3d-8956-4b36-bdac-dfb75b992291 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:27.970936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbfc3d-8956-4b36-bdac-dfb75b992291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:27.972585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbfc3d-8956-4b36-bdac-dfb75b992291 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:27.984875 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 363/725] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:27 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:27.991179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831e601-058e-4aa2-b551-af6c17581883 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:28.004387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831e601-058e-4aa2-b551-af6c17581883 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:28.010482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cb576-e2a3-4794-a722-7c1506dfde56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:28.011361 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb576-e2a3-4794-a722-7c1506dfde56 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.011580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb576-e2a3-4794-a722-7c1506dfde56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.011852 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb576-e2a3-4794-a722-7c1506dfde56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.026669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cb576-e2a3-4794-a722-7c1506dfde56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:28.028546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cb576-e2a3-4794-a722-7c1506dfde56 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:28.045596 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-f68cb576-e2a3-4794-a722-7c1506dfde56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:28.047223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 363/726] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:28.053460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbfc3d-8956-4b36-bdac-dfb75b992291 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:28.066707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbfc3d-8956-4b36-bdac-dfb75b992291 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:28.074865 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb248c-d969-4219-910d-4dd4f0e2392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:28.075601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb248c-d969-4219-910d-4dd4f0e2392a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.075886 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb248c-d969-4219-910d-4dd4f0e2392a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.076155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb248c-d969-4219-910d-4dd4f0e2392a admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.076930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb248c-d969-4219-910d-4dd4f0e2392a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:28.077231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb248c-d969-4219-910d-4dd4f0e2392a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:28.078848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb248c-d969-4219-910d-4dd4f0e2392a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:28.093566 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 364/727] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:28.101913 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cb576-e2a3-4794-a722-7c1506dfde56 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:28.115754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cb576-e2a3-4794-a722-7c1506dfde56 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:28.123175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21355968-ac4f-4205-ab45-1b8729c9e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:28.124074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21355968-ac4f-4205-ab45-1b8729c9e466 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.124353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21355968-ac4f-4205-ab45-1b8729c9e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.124708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21355968-ac4f-4205-ab45-1b8729c9e466 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.137584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21355968-ac4f-4205-ab45-1b8729c9e466 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:28.139763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21355968-ac4f-4205-ab45-1b8729c9e466 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:28.158824 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-21355968-ac4f-4205-ab45-1b8729c9e466 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 13 16:36:28.160327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 364/728] 10.222.0.62 () {56 vars in 1138 bytes} [Mon Dec 13 16:36:28 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:28.167180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb248c-d969-4219-910d-4dd4f0e2392a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:28.178717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb248c-d969-4219-910d-4dd4f0e2392a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:28.184514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f85e9-cc8f-481f-afb9-56d83ee863ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:28.185264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f85e9-cc8f-481f-afb9-56d83ee863ae admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.185632 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f85e9-cc8f-481f-afb9-56d83ee863ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.185956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f85e9-cc8f-481f-afb9-56d83ee863ae admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.186824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f85e9-cc8f-481f-afb9-56d83ee863ae admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:28.187184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f85e9-cc8f-481f-afb9-56d83ee863ae admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:28.189176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f85e9-cc8f-481f-afb9-56d83ee863ae admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:28.212104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 365/729] 10.222.0.62 () {56 vars in 1170 bytes} [Mon Dec 13 16:36:28 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:28.218633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21355968-ac4f-4205-ab45-1b8729c9e466 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:28.229756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21355968-ac4f-4205-ab45-1b8729c9e466 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:28.235694 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e23bd-ad1b-405b-b28e-d6680005d6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:28.236344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e23bd-ad1b-405b-b28e-d6680005d6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.236649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e23bd-ad1b-405b-b28e-d6680005d6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.236928 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e23bd-ad1b-405b-b28e-d6680005d6c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.248228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e23bd-ad1b-405b-b28e-d6680005d6c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:28.250130 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e23bd-ad1b-405b-b28e-d6680005d6c0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:28.262040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 365/730] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:28 2021] GET /identity/v3/auth/tokens => generated 1018 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:36:28.269278 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f85e9-cc8f-481f-afb9-56d83ee863ae admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:28.281528 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f85e9-cc8f-481f-afb9-56d83ee863ae admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:28.287303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e73974-c8e7-48e8-a9ad-ee1c92b61c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:28.288450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e73974-c8e7-48e8-a9ad-ee1c92b61c0d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.288963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e73974-c8e7-48e8-a9ad-ee1c92b61c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.289629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e73974-c8e7-48e8-a9ad-ee1c92b61c0d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.301506 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e73974-c8e7-48e8-a9ad-ee1c92b61c0d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:28.303705 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e73974-c8e7-48e8-a9ad-ee1c92b61c0d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:28.323999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-81e73974-c8e7-48e8-a9ad-ee1c92b61c0d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:28.323999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 366/731] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:28.330137 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e23bd-ad1b-405b-b28e-d6680005d6c0 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:28.339606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e23bd-ad1b-405b-b28e-d6680005d6c0 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:28.346593 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967cece-901d-4700-a722-1314c272c429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:28.347320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967cece-901d-4700-a722-1314c272c429 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.347619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967cece-901d-4700-a722-1314c272c429 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.347875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967cece-901d-4700-a722-1314c272c429 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.348699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967cece-901d-4700-a722-1314c272c429 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:28.349007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967cece-901d-4700-a722-1314c272c429 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:28.350761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967cece-901d-4700-a722-1314c272c429 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:28.366689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 366/732] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:28.372798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e73974-c8e7-48e8-a9ad-ee1c92b61c0d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:28.385588 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e73974-c8e7-48e8-a9ad-ee1c92b61c0d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:28.390780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a412953-caff-4635-acfa-4b35ea3c0df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:28.391569 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412953-caff-4635-acfa-4b35ea3c0df4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.391846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412953-caff-4635-acfa-4b35ea3c0df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.392118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a412953-caff-4635-acfa-4b35ea3c0df4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.399154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a412953-caff-4635-acfa-4b35ea3c0df4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:28.401140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a412953-caff-4635-acfa-4b35ea3c0df4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:28.420129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-2a412953-caff-4635-acfa-4b35ea3c0df4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:28.421674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 367/733] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:28.427643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967cece-901d-4700-a722-1314c272c429 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:28.441636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967cece-901d-4700-a722-1314c272c429 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:28.449362 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c801302-18bb-459d-85d1-ce92b272587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:28.450081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c801302-18bb-459d-85d1-ce92b272587b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.450366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c801302-18bb-459d-85d1-ce92b272587b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.450643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c801302-18bb-459d-85d1-ce92b272587b admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.451502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c801302-18bb-459d-85d1-ce92b272587b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:28.451807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c801302-18bb-459d-85d1-ce92b272587b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:28.453736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c801302-18bb-459d-85d1-ce92b272587b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:28.471434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 367/734] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:28.478018 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a412953-caff-4635-acfa-4b35ea3c0df4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:28.488545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a412953-caff-4635-acfa-4b35ea3c0df4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:28.493124 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f70e0-914b-400f-bc3b-cc8e0163b533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:28.493776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f70e0-914b-400f-bc3b-cc8e0163b533 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.494056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f70e0-914b-400f-bc3b-cc8e0163b533 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.494330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f70e0-914b-400f-bc3b-cc8e0163b533 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.495175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f70e0-914b-400f-bc3b-cc8e0163b533 admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=a541eff61b694cfab57bd9be29628a25) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:28.495483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f70e0-914b-400f-bc3b-cc8e0163b533 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:28.497358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f70e0-914b-400f-bc3b-cc8e0163b533 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:28.503576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 368/735] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:28 2021] GET /identity/v3/role_assignments?user.id=a541eff61b694cfab57bd9be29628a25&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:28.639314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8fb9b-3347-4971-b4b0-bbdd1de3ea51 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.639491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8fb9b-3347-4971-b4b0-bbdd1de3ea51 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.639774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8fb9b-3347-4971-b4b0-bbdd1de3ea51 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.642278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 368/736] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:28.648328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1ef2c-1b03-40d3-b1d5-3f2f226dd7d9 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.648728 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1ef2c-1b03-40d3-b1d5-3f2f226dd7d9 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.649013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1ef2c-1b03-40d3-b1d5-3f2f226dd7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.673691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-61f1ef2c-1b03-40d3-b1d5-3f2f226dd7d9 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:28.674922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-61f1ef2c-1b03-40d3-b1d5-3f2f226dd7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:28.683239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 369/737] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:28 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:28.727491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8fb9b-3347-4971-b4b0-bbdd1de3ea51 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:28.740445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8fb9b-3347-4971-b4b0-bbdd1de3ea51 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:28.745323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0ac3d2-53cd-487e-ac04-e853ca313c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:28.746000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ac3d2-53cd-487e-ac04-e853ca313c74 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:28.746282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ac3d2-53cd-487e-ac04-e853ca313c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:28.746556 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0ac3d2-53cd-487e-ac04-e853ca313c74 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:28.747312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ac3d2-53cd-487e-ac04-e853ca313c74 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:28.748339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-8e0ac3d2-53cd-487e-ac04-e853ca313c74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:28.748339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:36:28.748339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:36:28.749268 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0ac3d2-53cd-487e-ac04-e853ca313c74 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:28.786566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 369/738] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:36:28 2021] POST /identity/v3/services => generated 240 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:29.347166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea9a31-ecf9-427b-8b2e-47a4975c7df8 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:29.347804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea9a31-ecf9-427b-8b2e-47a4975c7df8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:29.347804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea9a31-ecf9-427b-8b2e-47a4975c7df8 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:29.349804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 370/739] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:29.355514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2201c7-e2c4-41b7-9642-98089eb706e3 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:29.355810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2201c7-e2c4-41b7-9642-98089eb706e3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:29.356082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2201c7-e2c4-41b7-9642-98089eb706e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:29.375830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7d2201c7-e2c4-41b7-9642-98089eb706e3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:29.377060 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7d2201c7-e2c4-41b7-9642-98089eb706e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:29.412502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 370/740] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:29 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:29.450276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea9a31-ecf9-427b-8b2e-47a4975c7df8 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:29.470574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea9a31-ecf9-427b-8b2e-47a4975c7df8 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:29.480946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b6fe4-e96e-404b-84ce-27a9a81d7ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:29.481761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6fe4-e96e-404b-84ce-27a9a81d7ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:29.482043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6fe4-e96e-404b-84ce-27a9a81d7ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:29.482316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6fe4-e96e-404b-84ce-27a9a81d7ce8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:29.495942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b6fe4-e96e-404b-84ce-27a9a81d7ce8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:29.503412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-082b6fe4-e96e-404b-84ce-27a9a81d7ce8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:36:29.505328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 371/741] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:29.512282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2201c7-e2c4-41b7-9642-98089eb706e3 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:29.522272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2201c7-e2c4-41b7-9642-98089eb706e3 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:29.531915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d823eb7-0f8a-43d0-bb17-b05d5c12ae06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:29.532976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d823eb7-0f8a-43d0-bb17-b05d5c12ae06 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:29.533468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d823eb7-0f8a-43d0-bb17-b05d5c12ae06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:29.533915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d823eb7-0f8a-43d0-bb17-b05d5c12ae06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:29.534909 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d823eb7-0f8a-43d0-bb17-b05d5c12ae06 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:29.535403 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d823eb7-0f8a-43d0-bb17-b05d5c12ae06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:29.537300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d823eb7-0f8a-43d0-bb17-b05d5c12ae06 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:29.553464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 371/742] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:29.560517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b6fe4-e96e-404b-84ce-27a9a81d7ce8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:29.571039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b6fe4-e96e-404b-84ce-27a9a81d7ce8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:29.580861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2539c-610e-4ab7-9d05-be2e499837a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:29.582109 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2539c-610e-4ab7-9d05-be2e499837a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:29.582617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2539c-610e-4ab7-9d05-be2e499837a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:29.583066 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2539c-610e-4ab7-9d05-be2e499837a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:29.599543 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2539c-610e-4ab7-9d05-be2e499837a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:29.602419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2539c-610e-4ab7-9d05-be2e499837a8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:29.620816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-1fd2539c-610e-4ab7-9d05-be2e499837a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:29.622644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 372/743] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:29.628862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d823eb7-0f8a-43d0-bb17-b05d5c12ae06 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:29.641210 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d823eb7-0f8a-43d0-bb17-b05d5c12ae06 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:29.651450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894bbb-0db5-46c8-a26c-eecedd64c550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:29.652433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894bbb-0db5-46c8-a26c-eecedd64c550 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:29.652950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894bbb-0db5-46c8-a26c-eecedd64c550 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:29.653400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894bbb-0db5-46c8-a26c-eecedd64c550 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:29.654325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a894bbb-0db5-46c8-a26c-eecedd64c550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:29.654806 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a894bbb-0db5-46c8-a26c-eecedd64c550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:29.656651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a894bbb-0db5-46c8-a26c-eecedd64c550 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:29.675511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 372/744] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:29.681735 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2539c-610e-4ab7-9d05-be2e499837a8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:29.692014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2539c-610e-4ab7-9d05-be2e499837a8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:29.700620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b7eb5-8e2f-4b4a-b292-8e86b4864250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:29.701800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b7eb5-8e2f-4b4a-b292-8e86b4864250 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:29.702276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b7eb5-8e2f-4b4a-b292-8e86b4864250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:29.702724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b7eb5-8e2f-4b4a-b292-8e86b4864250 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:29.715877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b7eb5-8e2f-4b4a-b292-8e86b4864250 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:29.718232 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b7eb5-8e2f-4b4a-b292-8e86b4864250 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:29.736493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-f10b7eb5-8e2f-4b4a-b292-8e86b4864250 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 13 16:36:29.738318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 373/745] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Dec 13 16:36:29 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:29.744602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894bbb-0db5-46c8-a26c-eecedd64c550 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:29.757575 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894bbb-0db5-46c8-a26c-eecedd64c550 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:29.765510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8cea8-8d74-4a6d-8b92-30fbcc9ae185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:29.766402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8cea8-8d74-4a6d-8b92-30fbcc9ae185 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:29.766883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8cea8-8d74-4a6d-8b92-30fbcc9ae185 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:29.767335 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8cea8-8d74-4a6d-8b92-30fbcc9ae185 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:29.768353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8cea8-8d74-4a6d-8b92-30fbcc9ae185 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:29.768862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8cea8-8d74-4a6d-8b92-30fbcc9ae185 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:29.770891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8cea8-8d74-4a6d-8b92-30fbcc9ae185 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:29.791734 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 373/746] 10.222.0.62 () {56 vars in 1154 bytes} [Mon Dec 13 16:36:29 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:29.798285 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b7eb5-8e2f-4b4a-b292-8e86b4864250 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:29.808674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b7eb5-8e2f-4b4a-b292-8e86b4864250 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:29.816555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d2a2a-a05c-46e6-a010-d29a60fa3983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:29.817613 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d2a2a-a05c-46e6-a010-d29a60fa3983 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:29.818097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d2a2a-a05c-46e6-a010-d29a60fa3983 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:29.818544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d2a2a-a05c-46e6-a010-d29a60fa3983 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:29.837576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d2a2a-a05c-46e6-a010-d29a60fa3983 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:29.839740 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51d2a2a-a05c-46e6-a010-d29a60fa3983 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:29.861602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-b51d2a2a-a05c-46e6-a010-d29a60fa3983 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:29.863451 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 374/747] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:29.869842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8cea8-8d74-4a6d-8b92-30fbcc9ae185 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:29.879910 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8cea8-8d74-4a6d-8b92-30fbcc9ae185 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:29.887524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421935e-c786-43bb-a9bb-28f16f896e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:29.888407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421935e-c786-43bb-a9bb-28f16f896e2e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:29.888918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421935e-c786-43bb-a9bb-28f16f896e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:29.889397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421935e-c786-43bb-a9bb-28f16f896e2e admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:29.890691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421935e-c786-43bb-a9bb-28f16f896e2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:29.891213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421935e-c786-43bb-a9bb-28f16f896e2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:29.893052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421935e-c786-43bb-a9bb-28f16f896e2e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:29.913779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 374/748] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:29.919977 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d2a2a-a05c-46e6-a010-d29a60fa3983 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:29.930165 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d2a2a-a05c-46e6-a010-d29a60fa3983 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:29.941077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c96f6-eba1-4c5d-a5be-865d2273feb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:29.942266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c96f6-eba1-4c5d-a5be-865d2273feb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:29.942775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c96f6-eba1-4c5d-a5be-865d2273feb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:29.943263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c96f6-eba1-4c5d-a5be-865d2273feb0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:29.951511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c96f6-eba1-4c5d-a5be-865d2273feb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:29.960621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c96f6-eba1-4c5d-a5be-865d2273feb0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:29.975090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-c13c96f6-eba1-4c5d-a5be-865d2273feb0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:29.980628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 375/749] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:29.983292 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421935e-c786-43bb-a9bb-28f16f896e2e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:29.997509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421935e-c786-43bb-a9bb-28f16f896e2e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.007041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057d28e-5304-465a-8b3b-2416e35a8060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.007947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057d28e-5304-465a-8b3b-2416e35a8060 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.008463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057d28e-5304-465a-8b3b-2416e35a8060 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.008965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057d28e-5304-465a-8b3b-2416e35a8060 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.009958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057d28e-5304-465a-8b3b-2416e35a8060 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:30.010460 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057d28e-5304-465a-8b3b-2416e35a8060 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.012522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057d28e-5304-465a-8b3b-2416e35a8060 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.026775 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 375/750] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:30.033334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c96f6-eba1-4c5d-a5be-865d2273feb0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.043601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c96f6-eba1-4c5d-a5be-865d2273feb0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.043783 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf978-87a6-4e0a-8cbd-a36275961ea2 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.043986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf978-87a6-4e0a-8cbd-a36275961ea2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.044182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdf978-87a6-4e0a-8cbd-a36275961ea2 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.046323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 376/751] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:30.052199 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d196d3-ee57-439c-8891-97034a6717ab None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.052486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d196d3-ee57-439c-8891-97034a6717ab None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.052792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d196d3-ee57-439c-8891-97034a6717ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.057203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481e238-2c20-48e6-aba6-06224411bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.058104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481e238-2c20-48e6-aba6-06224411bc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.058415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481e238-2c20-48e6-aba6-06224411bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.058651 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481e238-2c20-48e6-aba6-06224411bc0d admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/dfecc747eb8d431a8d57f4534d259de8/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.065606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481e238-2c20-48e6-aba6-06224411bc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=dfecc747eb8d431a8d57f4534d259de8, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.068262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0481e238-2c20-48e6-aba6-06224411bc0d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.082217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a2d196d3-ee57-439c-8891-97034a6717ab None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:30.083399 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a2d196d3-ee57-439c-8891-97034a6717ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:30.095840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 376/752] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:36:30 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/dfecc747eb8d431a8d57f4534d259de8/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:30.104744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 377/753] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:30 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:30.123978 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481e238-2c20-48e6-aba6-06224411bc0d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.209610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0481e238-2c20-48e6-aba6-06224411bc0d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.219038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f462-2fd3-4c3c-a3c7-cd404d80ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.219862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f462-2fd3-4c3c-a3c7-cd404d80ddaf admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.220142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f462-2fd3-4c3c-a3c7-cd404d80ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.220461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c23f462-2fd3-4c3c-a3c7-cd404d80ddaf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.235334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c23f462-2fd3-4c3c-a3c7-cd404d80ddaf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:30.242634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-3c23f462-2fd3-4c3c-a3c7-cd404d80ddaf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:36:30.243843 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 377/754] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:30.250543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d196d3-ee57-439c-8891-97034a6717ab None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.260135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d196d3-ee57-439c-8891-97034a6717ab None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.264619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eec43e-e688-4b00-bf66-1a5c35a3dd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.265724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eec43e-e688-4b00-bf66-1a5c35a3dd0a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.265972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eec43e-e688-4b00-bf66-1a5c35a3dd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.266247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eec43e-e688-4b00-bf66-1a5c35a3dd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.267064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eec43e-e688-4b00-bf66-1a5c35a3dd0a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:30.267370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eec43e-e688-4b00-bf66-1a5c35a3dd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.269074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eec43e-e688-4b00-bf66-1a5c35a3dd0a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.278956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 378/755] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:30.285294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f462-2fd3-4c3c-a3c7-cd404d80ddaf admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.296611 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c23f462-2fd3-4c3c-a3c7-cd404d80ddaf admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.301450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6f3d8-cc10-4bb4-b5e1-a38f4413b3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.302352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f3d8-cc10-4bb4-b5e1-a38f4413b3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.302612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f3d8-cc10-4bb4-b5e1-a38f4413b3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.302871 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6f3d8-cc10-4bb4-b5e1-a38f4413b3e9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.315554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6f3d8-cc10-4bb4-b5e1-a38f4413b3e9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.323104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6f3d8-cc10-4bb4-b5e1-a38f4413b3e9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.347547 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-cbf6f3d8-cc10-4bb4-b5e1-a38f4413b3e9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:30.348800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 378/756] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:30.355511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eec43e-e688-4b00-bf66-1a5c35a3dd0a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.366387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eec43e-e688-4b00-bf66-1a5c35a3dd0a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.371305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5a82a-02fb-40ef-a179-ba9c5d29ac24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.372055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a82a-02fb-40ef-a179-ba9c5d29ac24 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.372335 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a82a-02fb-40ef-a179-ba9c5d29ac24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.372639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5a82a-02fb-40ef-a179-ba9c5d29ac24 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.373409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5a82a-02fb-40ef-a179-ba9c5d29ac24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:30.373713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5a82a-02fb-40ef-a179-ba9c5d29ac24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.375508 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5a82a-02fb-40ef-a179-ba9c5d29ac24 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.392679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 379/757] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:30.397661 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6f3d8-cc10-4bb4-b5e1-a38f4413b3e9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.408499 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6f3d8-cc10-4bb4-b5e1-a38f4413b3e9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.413427 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a574ed2-0298-4ba8-a69d-e9618b64e369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.414301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a574ed2-0298-4ba8-a69d-e9618b64e369 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.414582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a574ed2-0298-4ba8-a69d-e9618b64e369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.414902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a574ed2-0298-4ba8-a69d-e9618b64e369 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.424928 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a574ed2-0298-4ba8-a69d-e9618b64e369 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.427097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a574ed2-0298-4ba8-a69d-e9618b64e369 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.442372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-7a574ed2-0298-4ba8-a69d-e9618b64e369 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 13 16:36:30.448742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 379/758] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:30.450638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5a82a-02fb-40ef-a179-ba9c5d29ac24 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.475244 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5a82a-02fb-40ef-a179-ba9c5d29ac24 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.490368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894c865-2f3b-4b46-a969-7cc7c818c8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.491068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894c865-2f3b-4b46-a969-7cc7c818c8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.491384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894c865-2f3b-4b46-a969-7cc7c818c8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.491660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894c865-2f3b-4b46-a969-7cc7c818c8d6 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.492520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894c865-2f3b-4b46-a969-7cc7c818c8d6 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:30.492849 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894c865-2f3b-4b46-a969-7cc7c818c8d6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.494742 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894c865-2f3b-4b46-a969-7cc7c818c8d6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.527980 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 380/759] 10.222.0.62 () {56 vars in 1156 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:30.534690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a574ed2-0298-4ba8-a69d-e9618b64e369 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.548137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a574ed2-0298-4ba8-a69d-e9618b64e369 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.557975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730ed3-6c9d-431b-bc0e-2c13d4ba6e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.558704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730ed3-6c9d-431b-bc0e-2c13d4ba6e38 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.558985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730ed3-6c9d-431b-bc0e-2c13d4ba6e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.559258 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730ed3-6c9d-431b-bc0e-2c13d4ba6e38 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.570927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04730ed3-6c9d-431b-bc0e-2c13d4ba6e38 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.572828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04730ed3-6c9d-431b-bc0e-2c13d4ba6e38 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.585929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 380/760] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:36:30.592325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894c865-2f3b-4b46-a969-7cc7c818c8d6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.603607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894c865-2f3b-4b46-a969-7cc7c818c8d6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.609257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ceadd-018e-485a-bba1-dd94481a84b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.610310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ceadd-018e-485a-bba1-dd94481a84b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.610804 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ceadd-018e-485a-bba1-dd94481a84b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.611284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ceadd-018e-485a-bba1-dd94481a84b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.622943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ceadd-018e-485a-bba1-dd94481a84b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.625210 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ceadd-018e-485a-bba1-dd94481a84b2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.646015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-384ceadd-018e-485a-bba1-dd94481a84b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:30.652511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 381/761] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:30.654844 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730ed3-6c9d-431b-bc0e-2c13d4ba6e38 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.664798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730ed3-6c9d-431b-bc0e-2c13d4ba6e38 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.669683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e94ba-e571-4316-a755-3dec9a062899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.670597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e94ba-e571-4316-a755-3dec9a062899 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.671069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e94ba-e571-4316-a755-3dec9a062899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.671545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e94ba-e571-4316-a755-3dec9a062899 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.672473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e94ba-e571-4316-a755-3dec9a062899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:30.672991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e94ba-e571-4316-a755-3dec9a062899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.674767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e94ba-e571-4316-a755-3dec9a062899 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.692679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 381/762] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:30.694589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ceadd-018e-485a-bba1-dd94481a84b2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.704807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ceadd-018e-485a-bba1-dd94481a84b2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.709899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac97daa-6c87-424a-bf66-8c761da1f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.711027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac97daa-6c87-424a-bf66-8c761da1f852 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.711583 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac97daa-6c87-424a-bf66-8c761da1f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.712070 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac97daa-6c87-424a-bf66-8c761da1f852 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.720561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac97daa-6c87-424a-bf66-8c761da1f852 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.723094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac97daa-6c87-424a-bf66-8c761da1f852 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.738330 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-cac97daa-6c87-424a-bf66-8c761da1f852 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:30.742956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 382/763] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:30.747122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e94ba-e571-4316-a755-3dec9a062899 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.757831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e94ba-e571-4316-a755-3dec9a062899 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.762736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b482b-ed20-4302-b9d0-7fcad4ebf645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.763661 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b482b-ed20-4302-b9d0-7fcad4ebf645 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.764180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b482b-ed20-4302-b9d0-7fcad4ebf645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.764691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b482b-ed20-4302-b9d0-7fcad4ebf645 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.766067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b482b-ed20-4302-b9d0-7fcad4ebf645 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:30.766585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b482b-ed20-4302-b9d0-7fcad4ebf645 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.768754 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b482b-ed20-4302-b9d0-7fcad4ebf645 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.787014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 382/764] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:30.788761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac97daa-6c87-424a-bf66-8c761da1f852 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.799847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac97daa-6c87-424a-bf66-8c761da1f852 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.805339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287ab76-b568-4cfc-a9c0-b8bd4594a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.806334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287ab76-b568-4cfc-a9c0-b8bd4594a06b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.806836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287ab76-b568-4cfc-a9c0-b8bd4594a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.807311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287ab76-b568-4cfc-a9c0-b8bd4594a06b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.808356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287ab76-b568-4cfc-a9c0-b8bd4594a06b admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=940c2c607c7b4f949593791360f99fbd) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:30.808950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287ab76-b568-4cfc-a9c0-b8bd4594a06b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.811109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287ab76-b568-4cfc-a9c0-b8bd4594a06b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.822057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 383/765] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/role_assignments?user.id=940c2c607c7b4f949593791360f99fbd&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=f3311ba27a464113b884aa5a1144945d => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:30.838773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91fdbd-6224-45b6-9353-6cf624b39e7e None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.839413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91fdbd-6224-45b6-9353-6cf624b39e7e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.839894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91fdbd-6224-45b6-9353-6cf624b39e7e None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.842016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 383/766] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:30.848318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b8b5-7ac9-47b0-9643-379c9831529a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.848967 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b8b5-7ac9-47b0-9643-379c9831529a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.849519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b8b5-7ac9-47b0-9643-379c9831529a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.878064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e1b4b8b5-7ac9-47b0-9643-379c9831529a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:30.879641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e1b4b8b5-7ac9-47b0-9643-379c9831529a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:30.888052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 384/767] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:30 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:30.924505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91fdbd-6224-45b6-9353-6cf624b39e7e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.942586 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91fdbd-6224-45b6-9353-6cf624b39e7e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:30.948464 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e282c-146b-4283-9333-a168ceec21f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:30.949777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e282c-146b-4283-9333-a168ceec21f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:30.950295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e282c-146b-4283-9333-a168ceec21f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:30.950865 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e282c-146b-4283-9333-a168ceec21f7 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:30.951739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e282c-146b-4283-9333-a168ceec21f7 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:30.953781 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e282c-146b-4283-9333-a168ceec21f7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:30.971416 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-975e282c-146b-4283-9333-a168ceec21f7 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 13 16:36:30.973066 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 384/768] 10.222.0.62 () {56 vars in 1150 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:30.979743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4b8b5-7ac9-47b0-9643-379c9831529a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:30.989785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4b8b5-7ac9-47b0-9643-379c9831529a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:31.000821 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9590a-4d0f-4db6-a52b-69e412fa2524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:31.001922 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9590a-4d0f-4db6-a52b-69e412fa2524 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.002443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9590a-4d0f-4db6-a52b-69e412fa2524 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.002911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9590a-4d0f-4db6-a52b-69e412fa2524 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.003879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9590a-4d0f-4db6-a52b-69e412fa2524 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:31.004387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9590a-4d0f-4db6-a52b-69e412fa2524 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:31.006475 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9590a-4d0f-4db6-a52b-69e412fa2524 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:31.013024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 385/769] 10.222.0.62 () {56 vars in 1145 bytes} [Mon Dec 13 16:36:30 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:31.022017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e282c-146b-4283-9333-a168ceec21f7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:31.033576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e282c-146b-4283-9333-a168ceec21f7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:31.039042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1931df9-3c33-456d-b8e8-deaf1924aa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:31.040214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1931df9-3c33-456d-b8e8-deaf1924aa24 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.040792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1931df9-3c33-456d-b8e8-deaf1924aa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.041356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1931df9-3c33-456d-b8e8-deaf1924aa24 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.042332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1931df9-3c33-456d-b8e8-deaf1924aa24 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:31.042885 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1931df9-3c33-456d-b8e8-deaf1924aa24 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:31.044952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1931df9-3c33-456d-b8e8-deaf1924aa24 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:31.051538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 385/770] 10.222.0.62 () {56 vars in 1145 bytes} [Mon Dec 13 16:36:31 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:31.061732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9590a-4d0f-4db6-a52b-69e412fa2524 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:31.072324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9590a-4d0f-4db6-a52b-69e412fa2524 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:31.085604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3da585-976f-490a-9150-d03bbf1f9289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:31.086690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3da585-976f-490a-9150-d03bbf1f9289 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.087276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3da585-976f-490a-9150-d03bbf1f9289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.087798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3da585-976f-490a-9150-d03bbf1f9289 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.088833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3da585-976f-490a-9150-d03bbf1f9289 admin admin] RBAC: Adding query filter params (interface=public, service_id=5694fff9724945d9985af7ab0727feb9, region_id=RegionOne) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:31.089388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3da585-976f-490a-9150-d03bbf1f9289 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:31.090598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-7f3da585-976f-490a-9150-d03bbf1f9289 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:31.090598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:36:31.090598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:36:31.091853 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3da585-976f-490a-9150-d03bbf1f9289 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:31.100564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 386/771] 10.222.0.62 () {56 vars in 1272 bytes} [Mon Dec 13 16:36:31 2021] GET /identity/v3/endpoints?service_id=5694fff9724945d9985af7ab0727feb9&interface=public®ion_id=RegionOne => generated 194 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:31.106570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1931df9-3c33-456d-b8e8-deaf1924aa24 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:31.117080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1931df9-3c33-456d-b8e8-deaf1924aa24 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:31.124702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20906d-72a1-415c-af0b-b328761d825a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:31.125689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20906d-72a1-415c-af0b-b328761d825a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.126211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20906d-72a1-415c-af0b-b328761d825a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.126679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20906d-72a1-415c-af0b-b328761d825a admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.127641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20906d-72a1-415c-af0b-b328761d825a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:31.129756 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20906d-72a1-415c-af0b-b328761d825a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:31.135635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 386/772] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Dec 13 16:36:31 2021] GET /identity/v3/services => generated 772 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:31.478366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094048-1700-4cad-ba8a-176f9034b560 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.479057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094048-1700-4cad-ba8a-176f9034b560 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.479556 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094048-1700-4cad-ba8a-176f9034b560 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.481570 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 387/773] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:31.487696 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb177eb-760d-4bff-b715-065d8af42256 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.488171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb177eb-760d-4bff-b715-065d8af42256 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.488244 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb177eb-760d-4bff-b715-065d8af42256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.510441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-ffb177eb-760d-4bff-b715-065d8af42256 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:31.511643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ffb177eb-760d-4bff-b715-065d8af42256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:31.526023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 387/774] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:31 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:31.552453 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094048-1700-4cad-ba8a-176f9034b560 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:31.573543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094048-1700-4cad-ba8a-176f9034b560 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:31.582434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f0cae-fbfb-4e1d-bc89-daf0a64f71c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:31.583490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f0cae-fbfb-4e1d-bc89-daf0a64f71c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.583964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f0cae-fbfb-4e1d-bc89-daf0a64f71c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.584427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f0cae-fbfb-4e1d-bc89-daf0a64f71c9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.600324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f0cae-fbfb-4e1d-bc89-daf0a64f71c9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:31.607745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-2d0f0cae-fbfb-4e1d-bc89-daf0a64f71c9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:31.614170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 388/775] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:31.615457 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb177eb-760d-4bff-b715-065d8af42256 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:31.635063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb177eb-760d-4bff-b715-065d8af42256 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:31.645497 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65feb52b-55b5-4d71-8eaf-724196b64ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:31.646211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feb52b-55b5-4d71-8eaf-724196b64ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.646496 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feb52b-55b5-4d71-8eaf-724196b64ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.646771 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feb52b-55b5-4d71-8eaf-724196b64ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.647625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65feb52b-55b5-4d71-8eaf-724196b64ab4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:31.647939 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65feb52b-55b5-4d71-8eaf-724196b64ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:31.649644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65feb52b-55b5-4d71-8eaf-724196b64ab4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:31.658578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 388/776] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:31.664724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f0cae-fbfb-4e1d-bc89-daf0a64f71c9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:31.675145 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f0cae-fbfb-4e1d-bc89-daf0a64f71c9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:31.684594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8cab-55f7-41fa-8919-440b3e4aa88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:31.685795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8cab-55f7-41fa-8919-440b3e4aa88a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.686286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8cab-55f7-41fa-8919-440b3e4aa88a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.686782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8cab-55f7-41fa-8919-440b3e4aa88a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.703658 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8cab-55f7-41fa-8919-440b3e4aa88a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:31.705784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8cab-55f7-41fa-8919-440b3e4aa88a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:31.735107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-0e7d8cab-55f7-41fa-8919-440b3e4aa88a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:31.736673 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 389/777] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:31.742954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65feb52b-55b5-4d71-8eaf-724196b64ab4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:31.762721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65feb52b-55b5-4d71-8eaf-724196b64ab4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:31.771042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a93b5-4b21-4bea-aa05-766e3da5d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:31.771719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a93b5-4b21-4bea-aa05-766e3da5d645 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.772001 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a93b5-4b21-4bea-aa05-766e3da5d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.772277 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a93b5-4b21-4bea-aa05-766e3da5d645 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.773393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a93b5-4b21-4bea-aa05-766e3da5d645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:31.773710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a93b5-4b21-4bea-aa05-766e3da5d645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:31.775318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96a93b5-4b21-4bea-aa05-766e3da5d645 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:31.794271 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 389/778] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:31.800354 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8cab-55f7-41fa-8919-440b3e4aa88a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:31.811067 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8cab-55f7-41fa-8919-440b3e4aa88a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:31.820550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759665-fbef-4cc4-9140-8b99ddb483ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:31.821712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759665-fbef-4cc4-9140-8b99ddb483ef admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.822275 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759665-fbef-4cc4-9140-8b99ddb483ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.822739 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb759665-fbef-4cc4-9140-8b99ddb483ef admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.832324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb759665-fbef-4cc4-9140-8b99ddb483ef admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:31.834635 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb759665-fbef-4cc4-9140-8b99ddb483ef admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:31.855635 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-cb759665-fbef-4cc4-9140-8b99ddb483ef admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 13 16:36:31.861305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 390/779] 10.222.0.62 () {56 vars in 1138 bytes} [Mon Dec 13 16:36:31 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:31.869950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a93b5-4b21-4bea-aa05-766e3da5d645 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:31.886385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a93b5-4b21-4bea-aa05-766e3da5d645 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:31.901368 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd07f-8074-42e7-a128-4443f9915922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:31.902069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd07f-8074-42e7-a128-4443f9915922 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.902353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd07f-8074-42e7-a128-4443f9915922 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.902626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cd07f-8074-42e7-a128-4443f9915922 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.903499 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cd07f-8074-42e7-a128-4443f9915922 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:31.903807 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cd07f-8074-42e7-a128-4443f9915922 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:31.905720 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cd07f-8074-42e7-a128-4443f9915922 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:31.932155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 390/780] 10.222.0.62 () {56 vars in 1170 bytes} [Mon Dec 13 16:36:31 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:31.938044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759665-fbef-4cc4-9140-8b99ddb483ef admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:31.948360 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb759665-fbef-4cc4-9140-8b99ddb483ef admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:31.958558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca01487-6d3c-4ef1-9ae8-6ad257106890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:31.959646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca01487-6d3c-4ef1-9ae8-6ad257106890 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:31.960168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca01487-6d3c-4ef1-9ae8-6ad257106890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:31.960697 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca01487-6d3c-4ef1-9ae8-6ad257106890 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:31.975165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca01487-6d3c-4ef1-9ae8-6ad257106890 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:31.977720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca01487-6d3c-4ef1-9ae8-6ad257106890 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:31.997576 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-8ca01487-6d3c-4ef1-9ae8-6ad257106890 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:31.999452 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 391/781] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:32.005169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd07f-8074-42e7-a128-4443f9915922 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:32.026774 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cd07f-8074-42e7-a128-4443f9915922 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:32.034559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84eb6-9b50-4ab1-997f-c8f7edd00274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:32.035239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84eb6-9b50-4ab1-997f-c8f7edd00274 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:32.035528 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84eb6-9b50-4ab1-997f-c8f7edd00274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:32.035789 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e84eb6-9b50-4ab1-997f-c8f7edd00274 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:32.036533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e84eb6-9b50-4ab1-997f-c8f7edd00274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:32.036897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e84eb6-9b50-4ab1-997f-c8f7edd00274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:32.038615 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e84eb6-9b50-4ab1-997f-c8f7edd00274 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:32.057297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 391/782] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:32.063069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca01487-6d3c-4ef1-9ae8-6ad257106890 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:32.074138 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca01487-6d3c-4ef1-9ae8-6ad257106890 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:32.085354 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26154d-5ab9-47e5-af63-c08b5171c914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:32.086527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26154d-5ab9-47e5-af63-c08b5171c914 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:32.087049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26154d-5ab9-47e5-af63-c08b5171c914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:32.087527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26154d-5ab9-47e5-af63-c08b5171c914 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:32.099938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26154d-5ab9-47e5-af63-c08b5171c914 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:32.102387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26154d-5ab9-47e5-af63-c08b5171c914 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:32.120741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-fd26154d-5ab9-47e5-af63-c08b5171c914 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:32.122210 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 392/783] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:32.128517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84eb6-9b50-4ab1-997f-c8f7edd00274 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:32.147035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e84eb6-9b50-4ab1-997f-c8f7edd00274 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:32.157668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099e611-e056-427e-977d-3e9fee55d799 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:32.158160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ca490-c3d0-4285-aec9-34344ad5d5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:32.158498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099e611-e056-427e-977d-3e9fee55d799 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:32.158837 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ca490-c3d0-4285-aec9-34344ad5d5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:32.159123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ca490-c3d0-4285-aec9-34344ad5d5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:32.159389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d099e611-e056-427e-977d-3e9fee55d799 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:32.159486 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ca490-c3d0-4285-aec9-34344ad5d5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:32.160205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ca490-c3d0-4285-aec9-34344ad5d5b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:32.160515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ca490-c3d0-4285-aec9-34344ad5d5b4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:32.162168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 393/784] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:32.162473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ca490-c3d0-4285-aec9-34344ad5d5b4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:32.167818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3375ca8-4f02-4143-afa3-90eff11387e2 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:32.168360 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3375ca8-4f02-4143-afa3-90eff11387e2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:32.168875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3375ca8-4f02-4143-afa3-90eff11387e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:32.183645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 392/785] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:32.189978 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ca490-c3d0-4285-aec9-34344ad5d5b4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:32.202080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ca490-c3d0-4285-aec9-34344ad5d5b4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:32.204108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b3375ca8-4f02-4143-afa3-90eff11387e2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:32.205332 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b3375ca8-4f02-4143-afa3-90eff11387e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:32.206907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe109c-459e-4fb0-888b-ee0e640627db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:32.207881 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe109c-459e-4fb0-888b-ee0e640627db admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:32.208160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe109c-459e-4fb0-888b-ee0e640627db admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:32.208435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe109c-459e-4fb0-888b-ee0e640627db admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/a541eff61b694cfab57bd9be29628a25/roles/0b0b2f3132974ff2a8a6fb9683036c6e` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:32.222468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 394/786] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:32 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:32.234508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe109c-459e-4fb0-888b-ee0e640627db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=a541eff61b694cfab57bd9be29628a25, role_id=0b0b2f3132974ff2a8a6fb9683036c6e)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:32.237352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe109c-459e-4fb0-888b-ee0e640627db admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:32.268011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 393/787] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:36:32 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/a541eff61b694cfab57bd9be29628a25/roles/0b0b2f3132974ff2a8a6fb9683036c6e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:32.280443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3375ca8-4f02-4143-afa3-90eff11387e2 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:32.298971 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3375ca8-4f02-4143-afa3-90eff11387e2 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:32.437440 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ff695-62a0-4b27-974e-0b8e538c645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:32.438304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ff695-62a0-4b27-974e-0b8e538c645d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:32.438586 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ff695-62a0-4b27-974e-0b8e538c645d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:32.438861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ff695-62a0-4b27-974e-0b8e538c645d admin admin] PATH_INFO: `/v3/services/network` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:32.439564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ff695-62a0-4b27-974e-0b8e538c645d admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:32.444601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ff695-62a0-4b27-974e-0b8e538c645d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:32.490917 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-845ff695-62a0-4b27-974e-0b8e538c645d admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 13 16:36:32.490917 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 395/788] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:32 2021] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:32.504599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe109c-459e-4fb0-888b-ee0e640627db admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:32.528900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe109c-459e-4fb0-888b-ee0e640627db admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:32.545397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379c26b-b710-4b10-98da-1cf110b84f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:32.546149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379c26b-b710-4b10-98da-1cf110b84f14 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:32.546429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379c26b-b710-4b10-98da-1cf110b84f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:32.546701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379c26b-b710-4b10-98da-1cf110b84f14 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:32.547437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379c26b-b710-4b10-98da-1cf110b84f14 admin admin] RBAC: Adding query filter params (name=network) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:32.547792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379c26b-b710-4b10-98da-1cf110b84f14 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:32.549453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379c26b-b710-4b10-98da-1cf110b84f14 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:32.562798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 394/789] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:32 2021] GET /identity/v3/services?name=network => generated 124 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:32.570059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ff695-62a0-4b27-974e-0b8e538c645d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:32.588159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ff695-62a0-4b27-974e-0b8e538c645d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:32.597874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622e521-f7b8-49f6-8456-03a9360c27af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:32.598549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622e521-f7b8-49f6-8456-03a9360c27af admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:32.598836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622e521-f7b8-49f6-8456-03a9360c27af admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:32.599111 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622e521-f7b8-49f6-8456-03a9360c27af admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:32.599842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622e521-f7b8-49f6-8456-03a9360c27af admin admin] RBAC: Adding query filter params (type=network) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:32.600146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622e521-f7b8-49f6-8456-03a9360c27af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:32.602024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622e521-f7b8-49f6-8456-03a9360c27af admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:32.612702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 396/790] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:32 2021] GET /identity/v3/services?type=network => generated 350 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:32.618887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379c26b-b710-4b10-98da-1cf110b84f14 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:32.636541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379c26b-b710-4b10-98da-1cf110b84f14 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:32.647033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e81b5f-59d0-4d96-a37c-23ec184aabf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:32.647833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e81b5f-59d0-4d96-a37c-23ec184aabf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:32.648120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e81b5f-59d0-4d96-a37c-23ec184aabf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:32.648390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e81b5f-59d0-4d96-a37c-23ec184aabf8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:32.649275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e81b5f-59d0-4d96-a37c-23ec184aabf8 admin admin] RBAC: Adding query filter params (interface=public, service_id=fe3bb71bc66c4fb582f534e8d6d82344, region_id=RegionOne) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:32.649584 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e81b5f-59d0-4d96-a37c-23ec184aabf8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:32.650675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-a2e81b5f-59d0-4d96-a37c-23ec184aabf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:32.650675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:36:32.650675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:36:32.651667 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e81b5f-59d0-4d96-a37c-23ec184aabf8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:32.667776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 395/791] 10.222.0.62 () {56 vars in 1272 bytes} [Mon Dec 13 16:36:32 2021] GET /identity/v3/endpoints?service_id=fe3bb71bc66c4fb582f534e8d6d82344&interface=public®ion_id=RegionOne => generated 194 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:32.673779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622e521-f7b8-49f6-8456-03a9360c27af admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:32.695316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622e521-f7b8-49f6-8456-03a9360c27af admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:32.706364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f5e42-51a5-4126-b758-bcd369166d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:32.707044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f5e42-51a5-4126-b758-bcd369166d68 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:32.707327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f5e42-51a5-4126-b758-bcd369166d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:32.707600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f5e42-51a5-4126-b758-bcd369166d68 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:32.708308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f5e42-51a5-4126-b758-bcd369166d68 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:32.711588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f5e42-51a5-4126-b758-bcd369166d68 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:32.728080 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 397/792] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Dec 13 16:36:32 2021] GET /identity/v3/services => generated 772 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:33.400679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99c02c-32b6-46fa-a20d-6790f72952ec None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.401012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99c02c-32b6-46fa-a20d-6790f72952ec None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.401242 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99c02c-32b6-46fa-a20d-6790f72952ec None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.403327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 396/793] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:33.409594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a7f1a-29a1-4d84-b337-5d24a8136a92 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.410083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a7f1a-29a1-4d84-b337-5d24a8136a92 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.410171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a7f1a-29a1-4d84-b337-5d24a8136a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.429561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-ec4a7f1a-29a1-4d84-b337-5d24a8136a92 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:33.431097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ec4a7f1a-29a1-4d84-b337-5d24a8136a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:33.447105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 398/794] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:33 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:33.486207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99c02c-32b6-46fa-a20d-6790f72952ec None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:33.506169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99c02c-32b6-46fa-a20d-6790f72952ec None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:33.510886 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b1cd7-99ec-466b-bd69-3f9fa9b71a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:33.511683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b1cd7-99ec-466b-bd69-3f9fa9b71a78 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.511962 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b1cd7-99ec-466b-bd69-3f9fa9b71a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.512233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b1cd7-99ec-466b-bd69-3f9fa9b71a78 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.531563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b1cd7-99ec-466b-bd69-3f9fa9b71a78 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:33.538560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-e37b1cd7-99ec-466b-bd69-3f9fa9b71a78 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:36:33.540090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 397/795] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:33.546622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a7f1a-29a1-4d84-b337-5d24a8136a92 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:33.564679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a7f1a-29a1-4d84-b337-5d24a8136a92 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:33.570261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2a661-8e3e-42c6-bd17-46a5f6df82f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:33.571401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a661-8e3e-42c6-bd17-46a5f6df82f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.571880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a661-8e3e-42c6-bd17-46a5f6df82f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.572346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2a661-8e3e-42c6-bd17-46a5f6df82f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.573377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2a661-8e3e-42c6-bd17-46a5f6df82f7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:33.573909 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2a661-8e3e-42c6-bd17-46a5f6df82f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:33.575771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2a661-8e3e-42c6-bd17-46a5f6df82f7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:33.592503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 399/796] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:33.598614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b1cd7-99ec-466b-bd69-3f9fa9b71a78 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:33.613598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b1cd7-99ec-466b-bd69-3f9fa9b71a78 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:33.620752 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10a671-1186-4d44-b0ac-284cb4eb50c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:33.621555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10a671-1186-4d44-b0ac-284cb4eb50c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.621836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10a671-1186-4d44-b0ac-284cb4eb50c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.622112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10a671-1186-4d44-b0ac-284cb4eb50c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.644363 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10a671-1186-4d44-b0ac-284cb4eb50c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:33.646392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10a671-1186-4d44-b0ac-284cb4eb50c2 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:33.675034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-1b10a671-1186-4d44-b0ac-284cb4eb50c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:33.676585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 398/797] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:33.685934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2a661-8e3e-42c6-bd17-46a5f6df82f7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:33.701518 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2a661-8e3e-42c6-bd17-46a5f6df82f7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:33.713264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80679bf4-8244-47d9-9c94-49d3fb6c9437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:33.713947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80679bf4-8244-47d9-9c94-49d3fb6c9437 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.714228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80679bf4-8244-47d9-9c94-49d3fb6c9437 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.714503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80679bf4-8244-47d9-9c94-49d3fb6c9437 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.715247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80679bf4-8244-47d9-9c94-49d3fb6c9437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:33.715552 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80679bf4-8244-47d9-9c94-49d3fb6c9437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:33.717237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80679bf4-8244-47d9-9c94-49d3fb6c9437 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:33.734711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 400/798] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:33.741003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10a671-1186-4d44-b0ac-284cb4eb50c2 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:33.753560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10a671-1186-4d44-b0ac-284cb4eb50c2 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:33.760977 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4237d9-734e-4a0f-b414-cda68bf2a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:33.761826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4237d9-734e-4a0f-b414-cda68bf2a328 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.762107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4237d9-734e-4a0f-b414-cda68bf2a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.762436 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4237d9-734e-4a0f-b414-cda68bf2a328 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.774649 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4237d9-734e-4a0f-b414-cda68bf2a328 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:33.776771 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4237d9-734e-4a0f-b414-cda68bf2a328 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:33.793859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-cd4237d9-734e-4a0f-b414-cda68bf2a328 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 13 16:36:33.795251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 399/799] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Dec 13 16:36:33 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:33.801635 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80679bf4-8244-47d9-9c94-49d3fb6c9437 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:33.817574 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80679bf4-8244-47d9-9c94-49d3fb6c9437 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:33.824768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa92ad-0fde-4024-ab0d-698d5bb138f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:33.825389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa92ad-0fde-4024-ab0d-698d5bb138f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.825672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa92ad-0fde-4024-ab0d-698d5bb138f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.825950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa92ad-0fde-4024-ab0d-698d5bb138f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.826805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa92ad-0fde-4024-ab0d-698d5bb138f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:33.827114 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa92ad-0fde-4024-ab0d-698d5bb138f8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:33.829193 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa92ad-0fde-4024-ab0d-698d5bb138f8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:33.856303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 401/800] 10.222.0.62 () {56 vars in 1154 bytes} [Mon Dec 13 16:36:33 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:33.862660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4237d9-734e-4a0f-b414-cda68bf2a328 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:33.881549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4237d9-734e-4a0f-b414-cda68bf2a328 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:33.894203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf59beb-9afa-4122-9794-99f111029fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:33.894869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf59beb-9afa-4122-9794-99f111029fdd admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.895149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf59beb-9afa-4122-9794-99f111029fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.895421 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf59beb-9afa-4122-9794-99f111029fdd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.901534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263516c4-6116-4330-8a08-89eb0f55d927 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.901819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263516c4-6116-4330-8a08-89eb0f55d927 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.902091 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263516c4-6116-4330-8a08-89eb0f55d927 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.904096 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 402/801] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:33.910189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57373-501f-42fa-acb4-fcd0b5db5c95 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.910475 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57373-501f-42fa-acb4-fcd0b5db5c95 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.910749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a57373-501f-42fa-acb4-fcd0b5db5c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.912060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf59beb-9afa-4122-9794-99f111029fdd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:33.913898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf59beb-9afa-4122-9794-99f111029fdd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:33.927403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 400/802] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:33 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:36:33.937616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf59beb-9afa-4122-9794-99f111029fdd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:33.940717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-86a57373-501f-42fa-acb4-fcd0b5db5c95 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:33.942112 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-86a57373-501f-42fa-acb4-fcd0b5db5c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:33.951792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf59beb-9afa-4122-9794-99f111029fdd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:33.954852 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 403/803] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:33 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:33.960824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be85dbd-1bd4-456a-afb9-f8c716819f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:33.961681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be85dbd-1bd4-456a-afb9-f8c716819f2f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:33.962050 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be85dbd-1bd4-456a-afb9-f8c716819f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:33.962322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be85dbd-1bd4-456a-afb9-f8c716819f2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:33.974928 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be85dbd-1bd4-456a-afb9-f8c716819f2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:33.977180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be85dbd-1bd4-456a-afb9-f8c716819f2f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.004160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-6be85dbd-1bd4-456a-afb9-f8c716819f2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:34.005775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 401/804] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:34.011880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57373-501f-42fa-acb4-fcd0b5db5c95 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.021918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a57373-501f-42fa-acb4-fcd0b5db5c95 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.029895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc260-d23f-4bd8-b193-38f7bf971380 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.030236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc260-d23f-4bd8-b193-38f7bf971380 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.030427 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adc260-d23f-4bd8-b193-38f7bf971380 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.032457 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 402/805] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:34.033151 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adc260-d23f-4bd8-b193-38f7bf971380 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.034172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb3cbd-0804-49ff-a033-0231107df513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.034903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3cbd-0804-49ff-a033-0231107df513 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.035185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3cbd-0804-49ff-a033-0231107df513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.035515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3cbd-0804-49ff-a033-0231107df513 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.036331 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb3cbd-0804-49ff-a033-0231107df513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:34.036669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb3cbd-0804-49ff-a033-0231107df513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.038418 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb3cbd-0804-49ff-a033-0231107df513 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.050980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adc260-d23f-4bd8-b193-38f7bf971380 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.051594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 404/806] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:34.053073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397594a-e229-4e7f-a3a6-126d40104dd5 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.053360 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397594a-e229-4e7f-a3a6-126d40104dd5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.053746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397594a-e229-4e7f-a3a6-126d40104dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.055795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb63d7-8c80-4aae-85ea-d511af768f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.056683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb63d7-8c80-4aae-85ea-d511af768f8e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.057028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb63d7-8c80-4aae-85ea-d511af768f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.057301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb63d7-8c80-4aae-85ea-d511af768f8e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.070027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb63d7-8c80-4aae-85ea-d511af768f8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:34.073538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7397594a-e229-4e7f-a3a6-126d40104dd5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:34.074845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7397594a-e229-4e7f-a3a6-126d40104dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:34.077050 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-ffeb63d7-8c80-4aae-85ea-d511af768f8e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:36:34.078512 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 403/807] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:34.079014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb63d7-8c80-4aae-85ea-d511af768f8e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.087469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 405/808] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:34 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:34.088115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397594a-e229-4e7f-a3a6-126d40104dd5 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.094234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb63d7-8c80-4aae-85ea-d511af768f8e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.098767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcaa6a-0a5e-461f-9a4c-c5dde915d81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.099556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcaa6a-0a5e-461f-9a4c-c5dde915d81e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.099838 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcaa6a-0a5e-461f-9a4c-c5dde915d81e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.100113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfcaa6a-0a5e-461f-9a4c-c5dde915d81e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.106522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397594a-e229-4e7f-a3a6-126d40104dd5 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.108336 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcaa6a-0a5e-461f-9a4c-c5dde915d81e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.110493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfcaa6a-0a5e-461f-9a4c-c5dde915d81e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.118075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69d490-ce4b-4b11-85c9-7d23cb169df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.118796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d490-ce4b-4b11-85c9-7d23cb169df5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.119160 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d490-ce4b-4b11-85c9-7d23cb169df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.119435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e69d490-ce4b-4b11-85c9-7d23cb169df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.120228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69d490-ce4b-4b11-85c9-7d23cb169df5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:34.120624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69d490-ce4b-4b11-85c9-7d23cb169df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.123835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-2bfcaa6a-0a5e-461f-9a4c-c5dde915d81e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:34.125060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 404/809] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:34.126711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e69d490-ce4b-4b11-85c9-7d23cb169df5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.132077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcaa6a-0a5e-461f-9a4c-c5dde915d81e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.141496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 406/810] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:34.142376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69d490-ce4b-4b11-85c9-7d23cb169df5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.145093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfcaa6a-0a5e-461f-9a4c-c5dde915d81e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.151094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b806c85-c22b-4857-8e94-d61a0f890d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.152052 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b806c85-c22b-4857-8e94-d61a0f890d3e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.152327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e69d490-ce4b-4b11-85c9-7d23cb169df5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.152715 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b806c85-c22b-4857-8e94-d61a0f890d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.153249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b806c85-c22b-4857-8e94-d61a0f890d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.154571 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b806c85-c22b-4857-8e94-d61a0f890d3e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:34.155102 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b806c85-c22b-4857-8e94-d61a0f890d3e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.157205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6a939-8607-47ae-bfc7-86da156cbc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.157681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b806c85-c22b-4857-8e94-d61a0f890d3e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.158170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6a939-8607-47ae-bfc7-86da156cbc4e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.158539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6a939-8607-47ae-bfc7-86da156cbc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.158907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f6a939-8607-47ae-bfc7-86da156cbc4e admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.159641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6a939-8607-47ae-bfc7-86da156cbc4e admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.161558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f6a939-8607-47ae-bfc7-86da156cbc4e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.173475 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-04f6a939-8607-47ae-bfc7-86da156cbc4e admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Dec 13 16:36:34.179394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 407/812] 10.222.0.62 () {56 vars in 1150 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:34.179394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6a939-8607-47ae-bfc7-86da156cbc4e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.179595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 405/812] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:34.181304 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b806c85-c22b-4857-8e94-d61a0f890d3e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.192085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f6a939-8607-47ae-bfc7-86da156cbc4e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.196129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b806c85-c22b-4857-8e94-d61a0f890d3e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.196931 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3ebeb-fd94-4468-9760-3063462ac2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.197952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ebeb-fd94-4468-9760-3063462ac2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.198235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ebeb-fd94-4468-9760-3063462ac2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.198537 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ebeb-fd94-4468-9760-3063462ac2a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.202504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7b840-9395-44a7-908f-e1a089d38fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.203394 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b840-9395-44a7-908f-e1a089d38fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.203883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b840-9395-44a7-908f-e1a089d38fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.204341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7b840-9395-44a7-908f-e1a089d38fd0 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.205297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7b840-9395-44a7-908f-e1a089d38fd0 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:34.205792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7b840-9395-44a7-908f-e1a089d38fd0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.207591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7b840-9395-44a7-908f-e1a089d38fd0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.213101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3ebeb-fd94-4468-9760-3063462ac2a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.213622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 406/813] 10.222.0.62 () {56 vars in 1145 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:34.214625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7b840-9395-44a7-908f-e1a089d38fd0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.215168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e3ebeb-fd94-4468-9760-3063462ac2a8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.224649 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7b840-9395-44a7-908f-e1a089d38fd0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.230566 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d7306-89b7-4774-a726-4672bbe6d34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.231496 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d7306-89b7-4774-a726-4672bbe6d34c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.232000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d7306-89b7-4774-a726-4672bbe6d34c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.232479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d7306-89b7-4774-a726-4672bbe6d34c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.233648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d7306-89b7-4774-a726-4672bbe6d34c admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=dfecc747eb8d431a8d57f4534d259de8) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:34.233843 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-c8e3ebeb-fd94-4468-9760-3063462ac2a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:34.234330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d7306-89b7-4774-a726-4672bbe6d34c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.235451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 408/814] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:34.236350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3ebeb-fd94-4468-9760-3063462ac2a8 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.236972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d7306-89b7-4774-a726-4672bbe6d34c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.247749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3ebeb-fd94-4468-9760-3063462ac2a8 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.247919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 407/815] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/role_assignments?user.id=dfecc747eb8d431a8d57f4534d259de8&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=f3311ba27a464113b884aa5a1144945d => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:34.248728 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d7306-89b7-4774-a726-4672bbe6d34c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.261350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063e38-892a-46e8-bd20-621bcb2b9fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.262037 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063e38-892a-46e8-bd20-621bcb2b9fcf admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.262314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063e38-892a-46e8-bd20-621bcb2b9fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.262584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063e38-892a-46e8-bd20-621bcb2b9fcf admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.263189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d7306-89b7-4774-a726-4672bbe6d34c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.263346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80063e38-892a-46e8-bd20-621bcb2b9fcf admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:34.263613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80063e38-892a-46e8-bd20-621bcb2b9fcf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.265825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80063e38-892a-46e8-bd20-621bcb2b9fcf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.275032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191f191-f406-4aaf-9408-2db5f46fec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.275734 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191f191-f406-4aaf-9408-2db5f46fec98 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.277113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191f191-f406-4aaf-9408-2db5f46fec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.277412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191f191-f406-4aaf-9408-2db5f46fec98 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.278193 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191f191-f406-4aaf-9408-2db5f46fec98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:34.280188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191f191-f406-4aaf-9408-2db5f46fec98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.282702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 409/816] 10.222.0.62 () {56 vars in 1145 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:34.283095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191f191-f406-4aaf-9408-2db5f46fec98 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.289030 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063e38-892a-46e8-bd20-621bcb2b9fcf admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.306572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063e38-892a-46e8-bd20-621bcb2b9fcf admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.311802 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 408/817] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:34.318853 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191f191-f406-4aaf-9408-2db5f46fec98 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.329566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54931b29-e079-41b7-861a-43033f2f8140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.329761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191f191-f406-4aaf-9408-2db5f46fec98 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.330177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54931b29-e079-41b7-861a-43033f2f8140 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.330470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54931b29-e079-41b7-861a-43033f2f8140 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.330748 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54931b29-e079-41b7-861a-43033f2f8140 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.335430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54931b29-e079-41b7-861a-43033f2f8140 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.336536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-54931b29-e079-41b7-861a-43033f2f8140 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:34.336536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:36:34.336536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:36:34.337544 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54931b29-e079-41b7-861a-43033f2f8140 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.345958 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a75da6-52a3-4185-a07f-32700f3a9a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.346789 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a75da6-52a3-4185-a07f-32700f3a9a5a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.347067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a75da6-52a3-4185-a07f-32700f3a9a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.347334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a75da6-52a3-4185-a07f-32700f3a9a5a admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.362983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a75da6-52a3-4185-a07f-32700f3a9a5a admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.365175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a75da6-52a3-4185-a07f-32700f3a9a5a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.380756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 410/818] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Dec 13 16:36:34 2021] POST /identity/v3/endpoints => generated 346 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:36:34.397102 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-c0a75da6-52a3-4185-a07f-32700f3a9a5a admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 13 16:36:34.400541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 409/819] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/users/swift => generated 83 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:34.407688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54931b29-e079-41b7-861a-43033f2f8140 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.434697 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54931b29-e079-41b7-861a-43033f2f8140 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.439661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679b61e-00f0-4aca-9577-414cd89639e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.440375 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679b61e-00f0-4aca-9577-414cd89639e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.440732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679b61e-00f0-4aca-9577-414cd89639e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.441140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679b61e-00f0-4aca-9577-414cd89639e1 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.442035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679b61e-00f0-4aca-9577-414cd89639e1 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:34.442392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679b61e-00f0-4aca-9577-414cd89639e1 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.444632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679b61e-00f0-4aca-9577-414cd89639e1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.465668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 411/820] 10.222.0.62 () {56 vars in 1156 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:34.473794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a75da6-52a3-4185-a07f-32700f3a9a5a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.487689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a75da6-52a3-4185-a07f-32700f3a9a5a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.493349 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04159d-0284-479a-8ddb-9ccaca3ee21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.494235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04159d-0284-479a-8ddb-9ccaca3ee21b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.494564 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04159d-0284-479a-8ddb-9ccaca3ee21b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.494835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04159d-0284-479a-8ddb-9ccaca3ee21b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.510732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04159d-0284-479a-8ddb-9ccaca3ee21b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.512739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c04159d-0284-479a-8ddb-9ccaca3ee21b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.535505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-6c04159d-0284-479a-8ddb-9ccaca3ee21b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:34.537106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 410/821] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:34.543836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679b61e-00f0-4aca-9577-414cd89639e1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.554546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679b61e-00f0-4aca-9577-414cd89639e1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.570692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f3401-571a-4ddb-bb4e-fab69e0bfc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.571389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3401-571a-4ddb-bb4e-fab69e0bfc20 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.571668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3401-571a-4ddb-bb4e-fab69e0bfc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.571942 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f3401-571a-4ddb-bb4e-fab69e0bfc20 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.572756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f3401-571a-4ddb-bb4e-fab69e0bfc20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:34.573032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f3401-571a-4ddb-bb4e-fab69e0bfc20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.574672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0f3401-571a-4ddb-bb4e-fab69e0bfc20 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.598803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 412/822] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:34.604882 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04159d-0284-479a-8ddb-9ccaca3ee21b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.615256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04159d-0284-479a-8ddb-9ccaca3ee21b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.621855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37fe4b-0461-4e5a-9fc1-8f3d360e78be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.622737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37fe4b-0461-4e5a-9fc1-8f3d360e78be admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.623012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37fe4b-0461-4e5a-9fc1-8f3d360e78be admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.623329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37fe4b-0461-4e5a-9fc1-8f3d360e78be admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.632437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37fe4b-0461-4e5a-9fc1-8f3d360e78be admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.634663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37fe4b-0461-4e5a-9fc1-8f3d360e78be admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.652158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-cd37fe4b-0461-4e5a-9fc1-8f3d360e78be admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:34.653605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 411/823] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:34.660276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f3401-571a-4ddb-bb4e-fab69e0bfc20 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.670814 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f3401-571a-4ddb-bb4e-fab69e0bfc20 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.676553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5286f12b-2db9-4513-b1ad-069e82185e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.677271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f12b-2db9-4513-b1ad-069e82185e3e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.677593 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f12b-2db9-4513-b1ad-069e82185e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.677870 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286f12b-2db9-4513-b1ad-069e82185e3e admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.678923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286f12b-2db9-4513-b1ad-069e82185e3e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:34.679330 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286f12b-2db9-4513-b1ad-069e82185e3e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.681279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5286f12b-2db9-4513-b1ad-069e82185e3e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.694865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 413/824] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:34.701693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37fe4b-0461-4e5a-9fc1-8f3d360e78be admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:34.712038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37fe4b-0461-4e5a-9fc1-8f3d360e78be admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:34.716516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de034a6-206c-403e-8e19-6c0adfa5ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:34.717441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de034a6-206c-403e-8e19-6c0adfa5ac9c admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:34.717717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de034a6-206c-403e-8e19-6c0adfa5ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:34.717990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de034a6-206c-403e-8e19-6c0adfa5ac9c admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/940c2c607c7b4f949593791360f99fbd/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:34.719954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de034a6-206c-403e-8e19-6c0adfa5ac9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=940c2c607c7b4f949593791360f99fbd, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:34.722619 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de034a6-206c-403e-8e19-6c0adfa5ac9c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:34.745067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 412/825] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:36:34 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/940c2c607c7b4f949593791360f99fbd/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:36:35.466582 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648050e4-308b-47c3-b3d3-9c21c929ba8d None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:35.467107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648050e4-308b-47c3-b3d3-9c21c929ba8d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:35.467107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648050e4-308b-47c3-b3d3-9c21c929ba8d None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:35.468919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 414/826] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:35.474905 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11416-d9e8-4294-b318-1db2b138f106 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:35.475226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11416-d9e8-4294-b318-1db2b138f106 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:35.475758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11416-d9e8-4294-b318-1db2b138f106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:35.496912 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-32b11416-d9e8-4294-b318-1db2b138f106 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:35.498106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-32b11416-d9e8-4294-b318-1db2b138f106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:35.572630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 413/827] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:35 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:35.609636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648050e4-308b-47c3-b3d3-9c21c929ba8d None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:35.630139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648050e4-308b-47c3-b3d3-9c21c929ba8d None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:35.635094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6745221-6b2e-41fe-b95f-c3f8fbcb53a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:35.635885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6745221-6b2e-41fe-b95f-c3f8fbcb53a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:35.636164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6745221-6b2e-41fe-b95f-c3f8fbcb53a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:35.636431 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6745221-6b2e-41fe-b95f-c3f8fbcb53a6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:35.650734 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6745221-6b2e-41fe-b95f-c3f8fbcb53a6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:35.657562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-e6745221-6b2e-41fe-b95f-c3f8fbcb53a6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:36:35.659061 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 415/828] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:36:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:35.665864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11416-d9e8-4294-b318-1db2b138f106 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:35.677460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11416-d9e8-4294-b318-1db2b138f106 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:35.684500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71081d75-a478-49e5-986f-3139b525821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:35.685205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71081d75-a478-49e5-986f-3139b525821c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:35.685486 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71081d75-a478-49e5-986f-3139b525821c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:35.685760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71081d75-a478-49e5-986f-3139b525821c admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:35.686531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71081d75-a478-49e5-986f-3139b525821c admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:35.686833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71081d75-a478-49e5-986f-3139b525821c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:35.688460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71081d75-a478-49e5-986f-3139b525821c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:35.700265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 414/829] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:36:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:35.708135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6745221-6b2e-41fe-b95f-c3f8fbcb53a6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:35.721619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6745221-6b2e-41fe-b95f-c3f8fbcb53a6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:35.729322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eee36-dbeb-43bb-aa47-cf4aeaa75e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:35.730120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eee36-dbeb-43bb-aa47-cf4aeaa75e48 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:35.730393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eee36-dbeb-43bb-aa47-cf4aeaa75e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:35.730661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eee36-dbeb-43bb-aa47-cf4aeaa75e48 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:35.752559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77eee36-dbeb-43bb-aa47-cf4aeaa75e48 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:35.754418 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77eee36-dbeb-43bb-aa47-cf4aeaa75e48 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:35.780087 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-c77eee36-dbeb-43bb-aa47-cf4aeaa75e48 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:35.781644 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 416/830] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:35.787762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71081d75-a478-49e5-986f-3139b525821c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:35.802223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71081d75-a478-49e5-986f-3139b525821c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:35.817933 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9304d-0078-4e88-988d-31036491b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:35.818626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9304d-0078-4e88-988d-31036491b2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:35.818907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9304d-0078-4e88-988d-31036491b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:35.819270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9304d-0078-4e88-988d-31036491b2f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:35.820200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9304d-0078-4e88-988d-31036491b2f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:35.820373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9304d-0078-4e88-988d-31036491b2f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:35.822000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9304d-0078-4e88-988d-31036491b2f8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:35.838437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 415/831] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:35.844560 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eee36-dbeb-43bb-aa47-cf4aeaa75e48 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:35.857542 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eee36-dbeb-43bb-aa47-cf4aeaa75e48 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:35.864633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fc758-e4da-4a6c-8f2e-f2035c8142f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:35.865448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc758-e4da-4a6c-8f2e-f2035c8142f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:35.865723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc758-e4da-4a6c-8f2e-f2035c8142f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:35.865996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fc758-e4da-4a6c-8f2e-f2035c8142f6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:35.885878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fc758-e4da-4a6c-8f2e-f2035c8142f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:35.887925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fc758-e4da-4a6c-8f2e-f2035c8142f6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:35.906823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-5b5fc758-e4da-4a6c-8f2e-f2035c8142f6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 13 16:36:35.908448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 417/832] 10.222.0.62 () {56 vars in 1138 bytes} [Mon Dec 13 16:36:35 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:35.915702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9304d-0078-4e88-988d-31036491b2f8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:35.930659 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9304d-0078-4e88-988d-31036491b2f8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:35.938902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec138e-7f8c-4c72-a82e-3a862ab2db9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:35.939608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec138e-7f8c-4c72-a82e-3a862ab2db9a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:35.939887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec138e-7f8c-4c72-a82e-3a862ab2db9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:35.940163 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec138e-7f8c-4c72-a82e-3a862ab2db9a admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:35.941143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec138e-7f8c-4c72-a82e-3a862ab2db9a admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:35.941452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec138e-7f8c-4c72-a82e-3a862ab2db9a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:35.943380 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec138e-7f8c-4c72-a82e-3a862ab2db9a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:35.954174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a7c81-a64e-4ffe-acf2-f58a3b90de74 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:35.954835 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a7c81-a64e-4ffe-acf2-f58a3b90de74 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:35.955311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a7c81-a64e-4ffe-acf2-f58a3b90de74 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:35.957310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 418/833] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:35.963960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ea1a-8e92-4966-b8ab-1097bb50feb3 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:35.964505 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ea1a-8e92-4966-b8ab-1097bb50feb3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:35.965044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ea1a-8e92-4966-b8ab-1097bb50feb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:35.983154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 416/834] 10.222.0.62 () {56 vars in 1170 bytes} [Mon Dec 13 16:36:35 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:35.986041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c0a7ea1a-8e92-4966-b8ab-1097bb50feb3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:35.987234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c0a7ea1a-8e92-4966-b8ab-1097bb50feb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:35.989822 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec138e-7f8c-4c72-a82e-3a862ab2db9a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:35.995345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 419/835] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:35 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:36.005758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec138e-7f8c-4c72-a82e-3a862ab2db9a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:36.023175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeff68e-4b6e-4111-be4b-74b81b2a60bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:36.024168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff68e-4b6e-4111-be4b-74b81b2a60bc admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:36.024672 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff68e-4b6e-4111-be4b-74b81b2a60bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:36.025162 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeff68e-4b6e-4111-be4b-74b81b2a60bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:36.033438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7ea1a-8e92-4966-b8ab-1097bb50feb3 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:36.041452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeff68e-4b6e-4111-be4b-74b81b2a60bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:36.042699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7ea1a-8e92-4966-b8ab-1097bb50feb3 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:36.043214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeff68e-4b6e-4111-be4b-74b81b2a60bc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:36.047145 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dbb59-e16c-4a59-83bc-c4a3d99b6822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:36.047944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dbb59-e16c-4a59-83bc-c4a3d99b6822 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:36.048226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dbb59-e16c-4a59-83bc-c4a3d99b6822 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:36.048500 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dbb59-e16c-4a59-83bc-c4a3d99b6822 admin admin] PATH_INFO: `/v3/services/network` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:36.049198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dbb59-e16c-4a59-83bc-c4a3d99b6822 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:36.050794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dbb59-e16c-4a59-83bc-c4a3d99b6822 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:36.060676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 417/836] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:35 2021] GET /identity/v3/auth/tokens => generated 1303 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:36:36.062115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-3b8dbb59-e16c-4a59-83bc-c4a3d99b6822 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Dec 13 16:36:36.063316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 420/837] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:36 2021] GET /identity/v3/services/network => generated 88 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:36.067061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeff68e-4b6e-4111-be4b-74b81b2a60bc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:36.070154 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dbb59-e16c-4a59-83bc-c4a3d99b6822 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:36.076350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeff68e-4b6e-4111-be4b-74b81b2a60bc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:36.081015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dbb59-e16c-4a59-83bc-c4a3d99b6822 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:36.083859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3d432-5719-4ac8-b34a-a94e71b21701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:36.084677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3d432-5719-4ac8-b34a-a94e71b21701 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:36.085016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3d432-5719-4ac8-b34a-a94e71b21701 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:36.085601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3d432-5719-4ac8-b34a-a94e71b21701 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:36.091481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea3225-f98d-438a-861c-77ae1844787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:36.093275 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3225-f98d-438a-861c-77ae1844787d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:36.093555 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3225-f98d-438a-861c-77ae1844787d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:36.093826 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3225-f98d-438a-861c-77ae1844787d admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:36.094542 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea3225-f98d-438a-861c-77ae1844787d admin admin] RBAC: Adding query filter params (name=network) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:36.094847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea3225-f98d-438a-861c-77ae1844787d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:36.096456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea3225-f98d-438a-861c-77ae1844787d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:36.109754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 421/838] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:36 2021] GET /identity/v3/services?name=network => generated 124 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:36.110984 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3d432-5719-4ac8-b34a-a94e71b21701 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:36.112897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3d432-5719-4ac8-b34a-a94e71b21701 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:36.115949 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea3225-f98d-438a-861c-77ae1844787d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:36.132098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea3225-f98d-438a-861c-77ae1844787d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:36.145960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-5ec3d432-5719-4ac8-b34a-a94e71b21701 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:36.147409 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 418/839] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:36.150182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa617255-fd20-4a32-8830-38a8747b5f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:36.150846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa617255-fd20-4a32-8830-38a8747b5f77 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:36.151120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa617255-fd20-4a32-8830-38a8747b5f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:36.151387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa617255-fd20-4a32-8830-38a8747b5f77 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:36.152104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa617255-fd20-4a32-8830-38a8747b5f77 admin admin] RBAC: Adding query filter params (type=network) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:36.152423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa617255-fd20-4a32-8830-38a8747b5f77 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:36.154013 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa617255-fd20-4a32-8830-38a8747b5f77 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:36.159641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 422/840] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:36 2021] GET /identity/v3/services?type=network => generated 350 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:36.160391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3d432-5719-4ac8-b34a-a94e71b21701 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:36.165693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa617255-fd20-4a32-8830-38a8747b5f77 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:36.175958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa617255-fd20-4a32-8830-38a8747b5f77 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:36.179676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3d432-5719-4ac8-b34a-a94e71b21701 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:36.180836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728a277-a509-498f-83c7-7774d4239b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:36.181490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728a277-a509-498f-83c7-7774d4239b03 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:36.181763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728a277-a509-498f-83c7-7774d4239b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:36.182032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7728a277-a509-498f-83c7-7774d4239b03 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:36.182784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728a277-a509-498f-83c7-7774d4239b03 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:36.184366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7728a277-a509-498f-83c7-7774d4239b03 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:36.194100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493b06f-c50a-4b84-9a6e-63966f3676b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:36.194831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493b06f-c50a-4b84-9a6e-63966f3676b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:36.195147 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493b06f-c50a-4b84-9a6e-63966f3676b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:36.195503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493b06f-c50a-4b84-9a6e-63966f3676b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:36.196253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493b06f-c50a-4b84-9a6e-63966f3676b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:36.196555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493b06f-c50a-4b84-9a6e-63966f3676b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:36.198202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493b06f-c50a-4b84-9a6e-63966f3676b2 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:36.211300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 419/841] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:36.219063 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 423/842] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Dec 13 16:36:36 2021] POST /identity/v3/endpoints => generated 327 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:36.219974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493b06f-c50a-4b84-9a6e-63966f3676b2 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:36.234904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493b06f-c50a-4b84-9a6e-63966f3676b2 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:36.270411 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0158c36-66aa-4063-870a-b1e4125b886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:36.271226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158c36-66aa-4063-870a-b1e4125b886c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:36.271500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158c36-66aa-4063-870a-b1e4125b886c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:36.271770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158c36-66aa-4063-870a-b1e4125b886c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:36.284110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0158c36-66aa-4063-870a-b1e4125b886c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:36.286175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0158c36-66aa-4063-870a-b1e4125b886c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:36.307413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-b0158c36-66aa-4063-870a-b1e4125b886c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:36.313970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 420/843] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 94 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:36.315413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728a277-a509-498f-83c7-7774d4239b03 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:36.330173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7728a277-a509-498f-83c7-7774d4239b03 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:36.340614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2773738-8a9b-4d2c-afd8-b7848974c6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:36.341295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2773738-8a9b-4d2c-afd8-b7848974c6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:36.341632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2773738-8a9b-4d2c-afd8-b7848974c6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:36.341840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2773738-8a9b-4d2c-afd8-b7848974c6a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:36.342652 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2773738-8a9b-4d2c-afd8-b7848974c6a4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:36.342953 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2773738-8a9b-4d2c-afd8-b7848974c6a4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:36.344864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2773738-8a9b-4d2c-afd8-b7848974c6a4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:36.364506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 424/844] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:36.371482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0158c36-66aa-4063-870a-b1e4125b886c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:36.382303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0158c36-66aa-4063-870a-b1e4125b886c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:36.398705 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d02f8d-a225-4970-8865-7885dc5db60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:36.399395 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02f8d-a225-4970-8865-7885dc5db60c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:36.399676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02f8d-a225-4970-8865-7885dc5db60c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:36.399942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02f8d-a225-4970-8865-7885dc5db60c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:36.400833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d02f8d-a225-4970-8865-7885dc5db60c admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=a541eff61b694cfab57bd9be29628a25) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:36.401144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d02f8d-a225-4970-8865-7885dc5db60c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:36.403062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d02f8d-a225-4970-8865-7885dc5db60c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:36.410209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 421/845] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:36 2021] GET /identity/v3/role_assignments?user.id=a541eff61b694cfab57bd9be29628a25&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:37.270725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe58da2-550f-4d59-bcc0-b9d3eaab92d9 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.271445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe58da2-550f-4d59-bcc0-b9d3eaab92d9 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.271445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe58da2-550f-4d59-bcc0-b9d3eaab92d9 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.273576 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 425/846] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:37.279630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0908f8-b394-4316-8d23-48cc07707bd6 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.280160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0908f8-b394-4316-8d23-48cc07707bd6 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.280160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0908f8-b394-4316-8d23-48cc07707bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.286569 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ccbda-dce7-43f1-9cf2-ac6d75d48d54 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.286847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ccbda-dce7-43f1-9cf2-ac6d75d48d54 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.287121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ccbda-dce7-43f1-9cf2-ac6d75d48d54 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.289649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 426/847] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:37.295436 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07095b62-167d-42c1-a591-922c60dbbf09 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.295717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07095b62-167d-42c1-a591-922c60dbbf09 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.295991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07095b62-167d-42c1-a591-922c60dbbf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.302654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-6f0908f8-b394-4316-8d23-48cc07707bd6 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:37.304182 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6f0908f8-b394-4316-8d23-48cc07707bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:37.312443 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 422/848] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:37 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:37.326998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-07095b62-167d-42c1-a591-922c60dbbf09 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:37.326998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-07095b62-167d-42c1-a591-922c60dbbf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:37.332748 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 427/849] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:37 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:37.339436 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0908f8-b394-4316-8d23-48cc07707bd6 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.348999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0908f8-b394-4316-8d23-48cc07707bd6 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.353844 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081b494-42f0-4d3a-9a1f-b7718e13fa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.354869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081b494-42f0-4d3a-9a1f-b7718e13fa8b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.355442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081b494-42f0-4d3a-9a1f-b7718e13fa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.355932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0081b494-42f0-4d3a-9a1f-b7718e13fa8b admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.356699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07095b62-167d-42c1-a591-922c60dbbf09 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.357044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081b494-42f0-4d3a-9a1f-b7718e13fa8b admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.358859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0081b494-42f0-4d3a-9a1f-b7718e13fa8b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.366413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07095b62-167d-42c1-a591-922c60dbbf09 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.371003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700f0f4-aaa4-45eb-89f4-adc0857afb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.371351 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-0081b494-42f0-4d3a-9a1f-b7718e13fa8b admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 13 16:36:37.371820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f0f4-aaa4-45eb-89f4-adc0857afb72 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.372097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f0f4-aaa4-45eb-89f4-adc0857afb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.372366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700f0f4-aaa4-45eb-89f4-adc0857afb72 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.373076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700f0f4-aaa4-45eb-89f4-adc0857afb72 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.378998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0700f0f4-aaa4-45eb-89f4-adc0857afb72 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.379301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 423/850] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:37.380736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081b494-42f0-4d3a-9a1f-b7718e13fa8b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.386950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-0700f0f4-aaa4-45eb-89f4-adc0857afb72 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 13 16:36:37.388413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 428/851] 10.222.0.62 () {56 vars in 1153 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:37.391762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0081b494-42f0-4d3a-9a1f-b7718e13fa8b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.395503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700f0f4-aaa4-45eb-89f4-adc0857afb72 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.397055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8c653-d4e5-4899-a47c-d18155b6e724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.397974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8c653-d4e5-4899-a47c-d18155b6e724 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.398466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8c653-d4e5-4899-a47c-d18155b6e724 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.398930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8c653-d4e5-4899-a47c-d18155b6e724 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.399843 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8c653-d4e5-4899-a47c-d18155b6e724 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:37.400335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8c653-d4e5-4899-a47c-d18155b6e724 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.402145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8c653-d4e5-4899-a47c-d18155b6e724 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.405405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0700f0f4-aaa4-45eb-89f4-adc0857afb72 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.407556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 424/852] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:37.414522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8c653-d4e5-4899-a47c-d18155b6e724 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.414646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea3398-bd12-44d3-b567-e5f6bf3e51e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.415390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3398-bd12-44d3-b567-e5f6bf3e51e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.415667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3398-bd12-44d3-b567-e5f6bf3e51e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.415938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3398-bd12-44d3-b567-e5f6bf3e51e3 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.416682 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea3398-bd12-44d3-b567-e5f6bf3e51e3 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:37.416984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea3398-bd12-44d3-b567-e5f6bf3e51e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.418578 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea3398-bd12-44d3-b567-e5f6bf3e51e3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.423742 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 429/853] 10.222.0.62 () {56 vars in 1147 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:37.424086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8c653-d4e5-4899-a47c-d18155b6e724 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.430164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea3398-bd12-44d3-b567-e5f6bf3e51e3 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.432886 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a59ca4-7378-427e-bf86-7745c31fffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.433550 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a59ca4-7378-427e-bf86-7745c31fffb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.433829 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a59ca4-7378-427e-bf86-7745c31fffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.434101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a59ca4-7378-427e-bf86-7745c31fffb3 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.435038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a59ca4-7378-427e-bf86-7745c31fffb3 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:37.435353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a59ca4-7378-427e-bf86-7745c31fffb3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.437703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a59ca4-7378-427e-bf86-7745c31fffb3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.439715 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea3398-bd12-44d3-b567-e5f6bf3e51e3 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.443407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 425/854] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:37.445216 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd330e49-b1f3-425d-8c90-596abcfc6e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.445934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd330e49-b1f3-425d-8c90-596abcfc6e88 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.446277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd330e49-b1f3-425d-8c90-596abcfc6e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.446608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd330e49-b1f3-425d-8c90-596abcfc6e88 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.447395 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd330e49-b1f3-425d-8c90-596abcfc6e88 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:37.447760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd330e49-b1f3-425d-8c90-596abcfc6e88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.449479 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd330e49-b1f3-425d-8c90-596abcfc6e88 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.455122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 430/855] 10.222.0.62 () {56 vars in 1147 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:37.600272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e611-2c24-44f3-9546-a95f372284f5 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.600504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e611-2c24-44f3-9546-a95f372284f5 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.600787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0e611-2c24-44f3-9546-a95f372284f5 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.603088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 426/856] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:37.609760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06343c75-4ced-4edc-8fb4-1c0df435b890 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.610109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06343c75-4ced-4edc-8fb4-1c0df435b890 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.610312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06343c75-4ced-4edc-8fb4-1c0df435b890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.630023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-06343c75-4ced-4edc-8fb4-1c0df435b890 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:37.631289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-06343c75-4ced-4edc-8fb4-1c0df435b890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:37.640123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 431/857] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:37 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:37.664944 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e611-2c24-44f3-9546-a95f372284f5 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.679535 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0e611-2c24-44f3-9546-a95f372284f5 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.684205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816913a8-433c-4dc3-ae8c-c9f6bb378120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.685063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816913a8-433c-4dc3-ae8c-c9f6bb378120 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.685344 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816913a8-433c-4dc3-ae8c-c9f6bb378120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.685616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816913a8-433c-4dc3-ae8c-c9f6bb378120 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.698789 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816913a8-433c-4dc3-ae8c-c9f6bb378120 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:37.705813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-816913a8-433c-4dc3-ae8c-c9f6bb378120 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:36:37.707342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 427/858] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:37.714117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06343c75-4ced-4edc-8fb4-1c0df435b890 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.725014 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06343c75-4ced-4edc-8fb4-1c0df435b890 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.729677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117a599-0e8b-4c99-b22c-a38d3c022231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.730348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117a599-0e8b-4c99-b22c-a38d3c022231 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.730623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117a599-0e8b-4c99-b22c-a38d3c022231 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.730891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117a599-0e8b-4c99-b22c-a38d3c022231 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.731649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117a599-0e8b-4c99-b22c-a38d3c022231 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:37.731947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117a599-0e8b-4c99-b22c-a38d3c022231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.733649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117a599-0e8b-4c99-b22c-a38d3c022231 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.743943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 432/859] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:37.750446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816913a8-433c-4dc3-ae8c-c9f6bb378120 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.762574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816913a8-433c-4dc3-ae8c-c9f6bb378120 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.767679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6b0ad-1652-49e1-862f-3caccdd07a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.768741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b0ad-1652-49e1-862f-3caccdd07a29 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.769210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b0ad-1652-49e1-862f-3caccdd07a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.769668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6b0ad-1652-49e1-862f-3caccdd07a29 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.780876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6b0ad-1652-49e1-862f-3caccdd07a29 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.783023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6b0ad-1652-49e1-862f-3caccdd07a29 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.800018 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-c4b6b0ad-1652-49e1-862f-3caccdd07a29 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:37.801898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 428/860] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:37.808219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117a599-0e8b-4c99-b22c-a38d3c022231 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.818107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117a599-0e8b-4c99-b22c-a38d3c022231 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.822819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20eb16-edd9-412b-9d6f-14ee14069c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.823722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20eb16-edd9-412b-9d6f-14ee14069c96 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.824193 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20eb16-edd9-412b-9d6f-14ee14069c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.824702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20eb16-edd9-412b-9d6f-14ee14069c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.825619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20eb16-edd9-412b-9d6f-14ee14069c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:37.826107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20eb16-edd9-412b-9d6f-14ee14069c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.827874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20eb16-edd9-412b-9d6f-14ee14069c96 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.841040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 433/861] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:37.847395 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6b0ad-1652-49e1-862f-3caccdd07a29 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.858505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6b0ad-1652-49e1-862f-3caccdd07a29 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.863418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc6175-f00d-4742-9b9d-4e553ef2011f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.864452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6175-f00d-4742-9b9d-4e553ef2011f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.864990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6175-f00d-4742-9b9d-4e553ef2011f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.865476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc6175-f00d-4742-9b9d-4e553ef2011f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.873919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc6175-f00d-4742-9b9d-4e553ef2011f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.876222 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc6175-f00d-4742-9b9d-4e553ef2011f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.891217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-fecc6175-f00d-4742-9b9d-4e553ef2011f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Dec 13 16:36:37.893051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 429/862] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:37.899502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20eb16-edd9-412b-9d6f-14ee14069c96 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.909919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20eb16-edd9-412b-9d6f-14ee14069c96 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.914821 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68149bd-0e7c-4b38-b350-e0bfd32a4634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.915768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68149bd-0e7c-4b38-b350-e0bfd32a4634 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.916236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68149bd-0e7c-4b38-b350-e0bfd32a4634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.916770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68149bd-0e7c-4b38-b350-e0bfd32a4634 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.917799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68149bd-0e7c-4b38-b350-e0bfd32a4634 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:37.918319 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68149bd-0e7c-4b38-b350-e0bfd32a4634 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.920388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68149bd-0e7c-4b38-b350-e0bfd32a4634 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.939108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 434/863] 10.222.0.62 () {56 vars in 1156 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:37.945486 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc6175-f00d-4742-9b9d-4e553ef2011f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:37.955908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc6175-f00d-4742-9b9d-4e553ef2011f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:37.961243 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b30fd-10aa-4dc6-ba24-4cba939b06e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:37.962162 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b30fd-10aa-4dc6-ba24-4cba939b06e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:37.962682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b30fd-10aa-4dc6-ba24-4cba939b06e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:37.963246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b30fd-10aa-4dc6-ba24-4cba939b06e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:37.972146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b30fd-10aa-4dc6-ba24-4cba939b06e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:37.974174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b30fd-10aa-4dc6-ba24-4cba939b06e6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:37.983854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 430/864] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:36:37.990249 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68149bd-0e7c-4b38-b350-e0bfd32a4634 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:38.000215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68149bd-0e7c-4b38-b350-e0bfd32a4634 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:38.005062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b967328-37f8-4d5d-b401-37a5822b85c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:38.006116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b967328-37f8-4d5d-b401-37a5822b85c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:38.006692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b967328-37f8-4d5d-b401-37a5822b85c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:38.007390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b967328-37f8-4d5d-b401-37a5822b85c5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:38.018172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b967328-37f8-4d5d-b401-37a5822b85c5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:38.020295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b967328-37f8-4d5d-b401-37a5822b85c5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:38.037710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-7b967328-37f8-4d5d-b401-37a5822b85c5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:38.039576 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 435/865] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:38.045796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b30fd-10aa-4dc6-ba24-4cba939b06e6 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:38.055624 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b30fd-10aa-4dc6-ba24-4cba939b06e6 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:38.060495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec120e-f452-4c86-b7ac-d9dcdea535c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:38.061419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec120e-f452-4c86-b7ac-d9dcdea535c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:38.061923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec120e-f452-4c86-b7ac-d9dcdea535c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:38.062390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec120e-f452-4c86-b7ac-d9dcdea535c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:38.063351 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec120e-f452-4c86-b7ac-d9dcdea535c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:38.063870 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec120e-f452-4c86-b7ac-d9dcdea535c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:38.065707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec120e-f452-4c86-b7ac-d9dcdea535c0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:38.077803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 431/866] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:38.083853 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b967328-37f8-4d5d-b401-37a5822b85c5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:38.093762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b967328-37f8-4d5d-b401-37a5822b85c5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:38.098520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483058d-09ba-4c6c-ad24-fcd516125d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:38.099552 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483058d-09ba-4c6c-ad24-fcd516125d23 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:38.100039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483058d-09ba-4c6c-ad24-fcd516125d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:38.100606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483058d-09ba-4c6c-ad24-fcd516125d23 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:38.107842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483058d-09ba-4c6c-ad24-fcd516125d23 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:38.110130 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483058d-09ba-4c6c-ad24-fcd516125d23 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:38.123224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-a483058d-09ba-4c6c-ad24-fcd516125d23 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:38.124635 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 436/867] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:38.130883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec120e-f452-4c86-b7ac-d9dcdea535c0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:38.141510 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec120e-f452-4c86-b7ac-d9dcdea535c0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:38.146214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c2e66-345b-4624-945d-c236632f7f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:38.147123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c2e66-345b-4624-945d-c236632f7f2a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:38.147846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c2e66-345b-4624-945d-c236632f7f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:38.148313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c2e66-345b-4624-945d-c236632f7f2a admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:38.149482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c2e66-345b-4624-945d-c236632f7f2a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:38.149994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c2e66-345b-4624-945d-c236632f7f2a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:38.152093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c2e66-345b-4624-945d-c236632f7f2a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:38.165304 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 432/868] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:38.171762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483058d-09ba-4c6c-ad24-fcd516125d23 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:38.182720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483058d-09ba-4c6c-ad24-fcd516125d23 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:38.187539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f8b0a-850f-472e-aa8c-ebb966e0628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:38.188438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f8b0a-850f-472e-aa8c-ebb966e0628e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:38.188947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f8b0a-850f-472e-aa8c-ebb966e0628e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:38.189436 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f8b0a-850f-472e-aa8c-ebb966e0628e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:38.190516 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f8b0a-850f-472e-aa8c-ebb966e0628e admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=940c2c607c7b4f949593791360f99fbd) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:38.191009 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f8b0a-850f-472e-aa8c-ebb966e0628e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:38.193097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f8b0a-850f-472e-aa8c-ebb966e0628e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:38.199416 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 437/869] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:38 2021] GET /identity/v3/role_assignments?user.id=940c2c607c7b4f949593791360f99fbd&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=f3311ba27a464113b884aa5a1144945d => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:38.975838 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653ee6-7aba-4ef2-a5ae-2ebdab8f479e None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:38.976438 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653ee6-7aba-4ef2-a5ae-2ebdab8f479e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:38.976438 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0653ee6-7aba-4ef2-a5ae-2ebdab8f479e None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:38.978441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 433/870] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:38.984621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ddda-9c41-4905-b46f-91156b74634d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:38.985072 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ddda-9c41-4905-b46f-91156b74634d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:38.985157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da0ddda-9c41-4905-b46f-91156b74634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.002987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-6da0ddda-9c41-4905-b46f-91156b74634d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:39.004183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6da0ddda-9c41-4905-b46f-91156b74634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:39.016682 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 438/871] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:38 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:39.036868 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0653ee6-7aba-4ef2-a5ae-2ebdab8f479e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.049166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0653ee6-7aba-4ef2-a5ae-2ebdab8f479e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.053644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c5885-5b22-4ff7-93aa-7946305f980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.054515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5885-5b22-4ff7-93aa-7946305f980b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.054793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5885-5b22-4ff7-93aa-7946305f980b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.055061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c5885-5b22-4ff7-93aa-7946305f980b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.065292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c5885-5b22-4ff7-93aa-7946305f980b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:39.072854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-433c5885-5b22-4ff7-93aa-7946305f980b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 13 16:36:39.079300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 434/872] 10.222.0.62 () {56 vars in 1141 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:39.080662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0ddda-9c41-4905-b46f-91156b74634d None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.089671 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da0ddda-9c41-4905-b46f-91156b74634d None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.094243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62337467-c541-4fe4-baa8-7a81762b4120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.094911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62337467-c541-4fe4-baa8-7a81762b4120 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.095189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62337467-c541-4fe4-baa8-7a81762b4120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.095463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62337467-c541-4fe4-baa8-7a81762b4120 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.096219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62337467-c541-4fe4-baa8-7a81762b4120 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:39.096522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62337467-c541-4fe4-baa8-7a81762b4120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.098146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62337467-c541-4fe4-baa8-7a81762b4120 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:39.111609 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 439/873] 10.222.0.62 () {56 vars in 1136 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:39.112976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c5885-5b22-4ff7-93aa-7946305f980b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.122700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c5885-5b22-4ff7-93aa-7946305f980b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.127138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72bf28-55cf-4432-9d60-a06a0c97f955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.127919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72bf28-55cf-4432-9d60-a06a0c97f955 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.128195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72bf28-55cf-4432-9d60-a06a0c97f955 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.128466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72bf28-55cf-4432-9d60-a06a0c97f955 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.139388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72bf28-55cf-4432-9d60-a06a0c97f955 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.141652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72bf28-55cf-4432-9d60-a06a0c97f955 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:39.158093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-1c72bf28-55cf-4432-9d60-a06a0c97f955 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:39.164599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 435/874] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:39.165953 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62337467-c541-4fe4-baa8-7a81762b4120 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.175566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62337467-c541-4fe4-baa8-7a81762b4120 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.180205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3f29d-6945-4e51-a37e-a14f7ef1e4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.180898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3f29d-6945-4e51-a37e-a14f7ef1e4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.181181 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3f29d-6945-4e51-a37e-a14f7ef1e4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.181455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3f29d-6945-4e51-a37e-a14f7ef1e4a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.182189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3f29d-6945-4e51-a37e-a14f7ef1e4a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:39.182492 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3f29d-6945-4e51-a37e-a14f7ef1e4a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.184085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c3f29d-6945-4e51-a37e-a14f7ef1e4a0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:39.200731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 440/875] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:39.202340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72bf28-55cf-4432-9d60-a06a0c97f955 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.212313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72bf28-55cf-4432-9d60-a06a0c97f955 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.216793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b65a2-8434-4258-91da-734eab7ec884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.217588 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b65a2-8434-4258-91da-734eab7ec884 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.217866 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b65a2-8434-4258-91da-734eab7ec884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.218135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b65a2-8434-4258-91da-734eab7ec884 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.226214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b65a2-8434-4258-91da-734eab7ec884 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.228222 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b65a2-8434-4258-91da-734eab7ec884 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:39.242953 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-ea6b65a2-8434-4258-91da-734eab7ec884 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 13 16:36:39.244210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 436/876] 10.222.0.62 () {56 vars in 1138 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:39.250555 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3f29d-6945-4e51-a37e-a14f7ef1e4a0 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.265207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3f29d-6945-4e51-a37e-a14f7ef1e4a0 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.269738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd751b3b-1a92-4826-970c-42a0d24d3e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.270454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751b3b-1a92-4826-970c-42a0d24d3e5f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.270732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751b3b-1a92-4826-970c-42a0d24d3e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.271006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd751b3b-1a92-4826-970c-42a0d24d3e5f admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.271900 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd751b3b-1a92-4826-970c-42a0d24d3e5f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:39.272337 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd751b3b-1a92-4826-970c-42a0d24d3e5f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.274229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd751b3b-1a92-4826-970c-42a0d24d3e5f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:39.296716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 441/877] 10.222.0.62 () {56 vars in 1170 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:39.298762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b65a2-8434-4258-91da-734eab7ec884 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.308943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b65a2-8434-4258-91da-734eab7ec884 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.313606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59c1f7-5a04-43d0-aa9a-745ec67df398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.314250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c1f7-5a04-43d0-aa9a-745ec67df398 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.314582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c1f7-5a04-43d0-aa9a-745ec67df398 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.314850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59c1f7-5a04-43d0-aa9a-745ec67df398 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.324233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59c1f7-5a04-43d0-aa9a-745ec67df398 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.326077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59c1f7-5a04-43d0-aa9a-745ec67df398 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:39.340703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 437/878] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:36:39.342356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd751b3b-1a92-4826-970c-42a0d24d3e5f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.352521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd751b3b-1a92-4826-970c-42a0d24d3e5f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.357403 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a05c9-8ac6-4743-a9fc-ed4734e1f18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.358255 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a05c9-8ac6-4743-a9fc-ed4734e1f18a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.358541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a05c9-8ac6-4743-a9fc-ed4734e1f18a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.358813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a05c9-8ac6-4743-a9fc-ed4734e1f18a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.370060 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a05c9-8ac6-4743-a9fc-ed4734e1f18a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.372025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a05c9-8ac6-4743-a9fc-ed4734e1f18a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:39.390332 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-6c2a05c9-8ac6-4743-a9fc-ed4734e1f18a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:39.396663 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 442/879] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:39.398199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59c1f7-5a04-43d0-aa9a-745ec67df398 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.407196 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59c1f7-5a04-43d0-aa9a-745ec67df398 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.411796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f2f06-7008-4999-8358-05b92a0067aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.412507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f2f06-7008-4999-8358-05b92a0067aa admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.412920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f2f06-7008-4999-8358-05b92a0067aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.413245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f2f06-7008-4999-8358-05b92a0067aa admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.413989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f2f06-7008-4999-8358-05b92a0067aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:39.414289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f2f06-7008-4999-8358-05b92a0067aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.415935 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f2f06-7008-4999-8358-05b92a0067aa admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:39.434865 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 438/880] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:39.436410 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a05c9-8ac6-4743-a9fc-ed4734e1f18a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.446653 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a05c9-8ac6-4743-a9fc-ed4734e1f18a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.451206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc942141-b1a7-4063-9540-63711ea5d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.452037 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc942141-b1a7-4063-9540-63711ea5d6ae admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.452316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc942141-b1a7-4063-9540-63711ea5d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.452685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc942141-b1a7-4063-9540-63711ea5d6ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.460510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc942141-b1a7-4063-9540-63711ea5d6ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.462541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc942141-b1a7-4063-9540-63711ea5d6ae admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:39.476828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-fc942141-b1a7-4063-9540-63711ea5d6ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:39.483660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 443/881] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:39.485232 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f2f06-7008-4999-8358-05b92a0067aa admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.496233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f2f06-7008-4999-8358-05b92a0067aa admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.501082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eda82c-b838-4193-b44f-823f3ab371cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.501763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eda82c-b838-4193-b44f-823f3ab371cc admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.502090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eda82c-b838-4193-b44f-823f3ab371cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.502417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eda82c-b838-4193-b44f-823f3ab371cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.503284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eda82c-b838-4193-b44f-823f3ab371cc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:39.503585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eda82c-b838-4193-b44f-823f3ab371cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.505608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eda82c-b838-4193-b44f-823f3ab371cc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:39.524737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 439/882] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:39.526393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc942141-b1a7-4063-9540-63711ea5d6ae admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.538036 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc942141-b1a7-4063-9540-63711ea5d6ae admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.542965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4b5415-ac79-423b-b246-39d1936022d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.543708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b5415-ac79-423b-b246-39d1936022d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.544027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b5415-ac79-423b-b246-39d1936022d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.544300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4b5415-ac79-423b-b246-39d1936022d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.545229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b5415-ac79-423b-b246-39d1936022d1 admin admin] RBAC: Adding query filter params (role.id=3e6310c0228e4643a7cd784cdf3aca43, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=a541eff61b694cfab57bd9be29628a25) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:39.545540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b5415-ac79-423b-b246-39d1936022d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.547599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4b5415-ac79-423b-b246-39d1936022d1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:39.560803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 444/883] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:39 2021] GET /identity/v3/role_assignments?user.id=a541eff61b694cfab57bd9be29628a25&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=3e6310c0228e4643a7cd784cdf3aca43 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:39.907516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2522-07f8-458d-9791-1b6d2bc63cb8 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.907516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2522-07f8-458d-9791-1b6d2bc63cb8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.907516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2f2522-07f8-458d-9791-1b6d2bc63cb8 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.909092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 440/884] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:39.916526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844c8d3-f960-45f2-9d7d-70e9b0e676d1 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.916526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844c8d3-f960-45f2-9d7d-70e9b0e676d1 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.916526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844c8d3-f960-45f2-9d7d-70e9b0e676d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.935554 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c844c8d3-f960-45f2-9d7d-70e9b0e676d1 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:39.936774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c844c8d3-f960-45f2-9d7d-70e9b0e676d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:39.945051 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 445/885] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:39 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:39.963104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cf3a4-7b4c-4484-8222-083c729e03ab None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.963392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cf3a4-7b4c-4484-8222-083c729e03ab None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.963671 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2cf3a4-7b4c-4484-8222-083c729e03ab None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.965610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 441/886] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:39.969938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844c8d3-f960-45f2-9d7d-70e9b0e676d1 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:39.975314 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2efe-3039-44ab-9fd9-54b3e33a7c56 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.975712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2efe-3039-44ab-9fd9-54b3e33a7c56 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.975904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde2efe-3039-44ab-9fd9-54b3e33a7c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.982287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844c8d3-f960-45f2-9d7d-70e9b0e676d1 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:39.988535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f8ab-bdb3-4768-a172-91eaff5fbc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:39.989223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f8ab-bdb3-4768-a172-91eaff5fbc84 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:39.989492 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f8ab-bdb3-4768-a172-91eaff5fbc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:39.989761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f8ab-bdb3-4768-a172-91eaff5fbc84 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:39.990505 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f8ab-bdb3-4768-a172-91eaff5fbc84 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:39.992217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f8ab-bdb3-4768-a172-91eaff5fbc84 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:40.000507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7bde2efe-3039-44ab-9fd9-54b3e33a7c56 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:40.001989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7bde2efe-3039-44ab-9fd9-54b3e33a7c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:40.010547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 446/888] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:36:39 2021] POST /identity/v3/services => generated 269 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:40.010717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 442/888] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:39 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:40.041368 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde2efe-3039-44ab-9fd9-54b3e33a7c56 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:40.051567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde2efe-3039-44ab-9fd9-54b3e33a7c56 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:40.067004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5abd1-8718-4ba9-a217-a956c975937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:40.067677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5abd1-8718-4ba9-a217-a956c975937e admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:40.068023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5abd1-8718-4ba9-a217-a956c975937e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:40.068297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5abd1-8718-4ba9-a217-a956c975937e admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:40.069223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5abd1-8718-4ba9-a217-a956c975937e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:40.071045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5abd1-8718-4ba9-a217-a956c975937e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:40.090725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 443/889] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:36:40 2021] POST /identity/v3/services => generated 251 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:40.687604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f1e9-09de-4683-b8ca-1390b07804c7 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:40.687880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f1e9-09de-4683-b8ca-1390b07804c7 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:40.688168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a20f1e9-09de-4683-b8ca-1390b07804c7 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:40.690179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 447/890] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:40.696388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da465ce-a8fd-4d0e-b5cd-75736c3f4f42 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:40.696698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da465ce-a8fd-4d0e-b5cd-75736c3f4f42 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:40.696973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da465ce-a8fd-4d0e-b5cd-75736c3f4f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:40.716034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7da465ce-a8fd-4d0e-b5cd-75736c3f4f42 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:40.717315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7da465ce-a8fd-4d0e-b5cd-75736c3f4f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:40.735169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 444/891] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:40 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:40.757791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20f1e9-09de-4683-b8ca-1390b07804c7 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:40.770319 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a20f1e9-09de-4683-b8ca-1390b07804c7 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:40.774741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecab41-3a18-4212-8399-73da9156b7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:40.775532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecab41-3a18-4212-8399-73da9156b7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:40.775808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecab41-3a18-4212-8399-73da9156b7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:40.776076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecab41-3a18-4212-8399-73da9156b7d2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:40.776769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecab41-3a18-4212-8399-73da9156b7d2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:40.778355 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecab41-3a18-4212-8399-73da9156b7d2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:40.789867 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-e8ecab41-3a18-4212-8399-73da9156b7d2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 13 16:36:40.791354 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 448/892] 10.222.0.62 () {56 vars in 1147 bytes} [Mon Dec 13 16:36:40 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:40.797953 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da465ce-a8fd-4d0e-b5cd-75736c3f4f42 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:40.807353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da465ce-a8fd-4d0e-b5cd-75736c3f4f42 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:40.811971 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77621d4-ae04-480d-8aba-1d96d555c6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:40.812714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77621d4-ae04-480d-8aba-1d96d555c6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:40.813001 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77621d4-ae04-480d-8aba-1d96d555c6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:40.813276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77621d4-ae04-480d-8aba-1d96d555c6a7 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:40.814016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77621d4-ae04-480d-8aba-1d96d555c6a7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:40.814321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77621d4-ae04-480d-8aba-1d96d555c6a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:40.815947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77621d4-ae04-480d-8aba-1d96d555c6a7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:40.821339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 445/893] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Dec 13 16:36:40 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:40.827500 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecab41-3a18-4212-8399-73da9156b7d2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:40.837924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecab41-3a18-4212-8399-73da9156b7d2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:40.842450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a743bf-95cc-410d-abde-d08e6af6385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:40.843158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a743bf-95cc-410d-abde-d08e6af6385c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:40.843442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a743bf-95cc-410d-abde-d08e6af6385c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:40.843717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a743bf-95cc-410d-abde-d08e6af6385c admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:40.844494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a743bf-95cc-410d-abde-d08e6af6385c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:40.844848 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a743bf-95cc-410d-abde-d08e6af6385c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:40.846517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a743bf-95cc-410d-abde-d08e6af6385c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:40.851824 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 449/894] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Dec 13 16:36:40 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:41.923358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193000-a1b8-4f71-91ef-73f1b396d815 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:41.923941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193000-a1b8-4f71-91ef-73f1b396d815 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:41.923941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193000-a1b8-4f71-91ef-73f1b396d815 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:41.925991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 446/895] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:41.932153 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d450-3512-4ce5-97cf-edac0c3d19e0 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:41.932632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d450-3512-4ce5-97cf-edac0c3d19e0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:41.932732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088d450-3512-4ce5-97cf-edac0c3d19e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:41.951038 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-5088d450-3512-4ce5-97cf-edac0c3d19e0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:41.952233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5088d450-3512-4ce5-97cf-edac0c3d19e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:41.964679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 450/896] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:41 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:41.983781 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86193000-a1b8-4f71-91ef-73f1b396d815 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:41.996289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86193000-a1b8-4f71-91ef-73f1b396d815 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.000665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9d8f9-4a83-496b-b18a-f62e71f29bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.001476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d8f9-4a83-496b-b18a-f62e71f29bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.001753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d8f9-4a83-496b-b18a-f62e71f29bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.002031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d8f9-4a83-496b-b18a-f62e71f29bf6 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.012640 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9d8f9-4a83-496b-b18a-f62e71f29bf6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:42.020328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-25c9d8f9-4a83-496b-b18a-f62e71f29bf6 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 13 16:36:42.027534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 447/897] 10.222.0.62 () {56 vars in 1141 bytes} [Mon Dec 13 16:36:41 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:42.029070 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d450-3512-4ce5-97cf-edac0c3d19e0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.038808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088d450-3512-4ce5-97cf-edac0c3d19e0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.043195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d729a0-f3df-413f-80f7-c6c92a2713c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.043879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d729a0-f3df-413f-80f7-c6c92a2713c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.044156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d729a0-f3df-413f-80f7-c6c92a2713c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.044430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d729a0-f3df-413f-80f7-c6c92a2713c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.045238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d729a0-f3df-413f-80f7-c6c92a2713c1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:42.045543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d729a0-f3df-413f-80f7-c6c92a2713c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.047205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d729a0-f3df-413f-80f7-c6c92a2713c1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.060691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 451/898] 10.222.0.62 () {56 vars in 1136 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:42.062445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9d8f9-4a83-496b-b18a-f62e71f29bf6 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.074302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9d8f9-4a83-496b-b18a-f62e71f29bf6 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.078923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b0480-057f-4028-a58f-41c75580cf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.079714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b0480-057f-4028-a58f-41c75580cf93 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.079992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b0480-057f-4028-a58f-41c75580cf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.080261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b0480-057f-4028-a58f-41c75580cf93 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.091358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b0480-057f-4028-a58f-41c75580cf93 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.093221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835b0480-057f-4028-a58f-41c75580cf93 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.110092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-835b0480-057f-4028-a58f-41c75580cf93 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:42.111623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 448/899] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:42.117799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d729a0-f3df-413f-80f7-c6c92a2713c1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.128256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d729a0-f3df-413f-80f7-c6c92a2713c1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.133552 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6790f2-e0c0-4b22-b17a-4e1ff5d04025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.134253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6790f2-e0c0-4b22-b17a-4e1ff5d04025 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.134535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6790f2-e0c0-4b22-b17a-4e1ff5d04025 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.134811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6790f2-e0c0-4b22-b17a-4e1ff5d04025 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.135584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6790f2-e0c0-4b22-b17a-4e1ff5d04025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:42.135896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6790f2-e0c0-4b22-b17a-4e1ff5d04025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.137637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6790f2-e0c0-4b22-b17a-4e1ff5d04025 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.156773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 452/900] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:42.159968 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b0480-057f-4028-a58f-41c75580cf93 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.171164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b0480-057f-4028-a58f-41c75580cf93 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.175754 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64240a53-1a24-4d4c-869f-55f1f75d270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.176549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64240a53-1a24-4d4c-869f-55f1f75d270a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.177025 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64240a53-1a24-4d4c-869f-55f1f75d270a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.177295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64240a53-1a24-4d4c-869f-55f1f75d270a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.185962 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64240a53-1a24-4d4c-869f-55f1f75d270a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.188045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64240a53-1a24-4d4c-869f-55f1f75d270a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.202442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-64240a53-1a24-4d4c-869f-55f1f75d270a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 13 16:36:42.208675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 449/901] 10.222.0.62 () {56 vars in 1138 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:42.210580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6790f2-e0c0-4b22-b17a-4e1ff5d04025 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.220617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6790f2-e0c0-4b22-b17a-4e1ff5d04025 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.225149 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc622e3-2227-4c9c-8884-85ccc1e4d63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.226031 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc622e3-2227-4c9c-8884-85ccc1e4d63c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.226220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc622e3-2227-4c9c-8884-85ccc1e4d63c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.226450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc622e3-2227-4c9c-8884-85ccc1e4d63c admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.227354 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc622e3-2227-4c9c-8884-85ccc1e4d63c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:42.227662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc622e3-2227-4c9c-8884-85ccc1e4d63c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.229581 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc622e3-2227-4c9c-8884-85ccc1e4d63c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.248161 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 453/902] 10.222.0.62 () {56 vars in 1170 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:42.253750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64240a53-1a24-4d4c-869f-55f1f75d270a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.263906 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64240a53-1a24-4d4c-869f-55f1f75d270a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.268983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b721-76f3-4ede-9e69-c676203b7434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.269770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b721-76f3-4ede-9e69-c676203b7434 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.270091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b721-76f3-4ede-9e69-c676203b7434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.270360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277b721-76f3-4ede-9e69-c676203b7434 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.281648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277b721-76f3-4ede-9e69-c676203b7434 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.283533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0277b721-76f3-4ede-9e69-c676203b7434 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.299713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-0277b721-76f3-4ede-9e69-c676203b7434 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:42.301115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 450/903] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:42.307518 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc622e3-2227-4c9c-8884-85ccc1e4d63c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.322075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc622e3-2227-4c9c-8884-85ccc1e4d63c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.322075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca755a8b-5a5e-4ba1-b61e-636854e73bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.323129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca755a8b-5a5e-4ba1-b61e-636854e73bbe admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.323129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca755a8b-5a5e-4ba1-b61e-636854e73bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.323422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca755a8b-5a5e-4ba1-b61e-636854e73bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.324601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca755a8b-5a5e-4ba1-b61e-636854e73bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:42.324601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca755a8b-5a5e-4ba1-b61e-636854e73bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.327921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca755a8b-5a5e-4ba1-b61e-636854e73bbe admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.340606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 454/904] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:42.344810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b721-76f3-4ede-9e69-c676203b7434 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.355053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277b721-76f3-4ede-9e69-c676203b7434 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.359623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767ce8-ed16-46e4-892b-3caa934acca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.360452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767ce8-ed16-46e4-892b-3caa934acca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.360761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767ce8-ed16-46e4-892b-3caa934acca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.361029 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767ce8-ed16-46e4-892b-3caa934acca8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.368138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4767ce8-ed16-46e4-892b-3caa934acca8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.370133 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4767ce8-ed16-46e4-892b-3caa934acca8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.383618 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-e4767ce8-ed16-46e4-892b-3caa934acca8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:42.385134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 451/905] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:42.391766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca755a8b-5a5e-4ba1-b61e-636854e73bbe admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.402853 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca755a8b-5a5e-4ba1-b61e-636854e73bbe admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.407421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83ba14-d5ec-4305-b6b4-75ad5d9b367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.408113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83ba14-d5ec-4305-b6b4-75ad5d9b367e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.408394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83ba14-d5ec-4305-b6b4-75ad5d9b367e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.408691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83ba14-d5ec-4305-b6b4-75ad5d9b367e admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.409536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83ba14-d5ec-4305-b6b4-75ad5d9b367e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:42.409839 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83ba14-d5ec-4305-b6b4-75ad5d9b367e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.411793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83ba14-d5ec-4305-b6b4-75ad5d9b367e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.429549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 455/906] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:42.434868 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767ce8-ed16-46e4-892b-3caa934acca8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.446872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767ce8-ed16-46e4-892b-3caa934acca8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.451505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cead8b-2d99-4936-9516-180365b67385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.452447 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cead8b-2d99-4936-9516-180365b67385 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.452762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cead8b-2d99-4936-9516-180365b67385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.453028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cead8b-2d99-4936-9516-180365b67385 admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/a541eff61b694cfab57bd9be29628a25/roles/3e6310c0228e4643a7cd784cdf3aca43` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.455301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cead8b-2d99-4936-9516-180365b67385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=a541eff61b694cfab57bd9be29628a25, role_id=3e6310c0228e4643a7cd784cdf3aca43)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.458042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cead8b-2d99-4936-9516-180365b67385 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.476802 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 452/907] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:36:42 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/a541eff61b694cfab57bd9be29628a25/roles/3e6310c0228e4643a7cd784cdf3aca43 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:36:42.559279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e9283-a6db-45e6-8cec-d4e11ba29889 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.559558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e9283-a6db-45e6-8cec-d4e11ba29889 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.559833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e9283-a6db-45e6-8cec-d4e11ba29889 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.561924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 456/908] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:42.567891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0aae-9d2b-46cb-9ccc-3474d57eac97 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.568177 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0aae-9d2b-46cb-9ccc-3474d57eac97 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.568450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed0aae-9d2b-46cb-9ccc-3474d57eac97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.591409 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-a8ed0aae-9d2b-46cb-9ccc-3474d57eac97 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:42.592712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a8ed0aae-9d2b-46cb-9ccc-3474d57eac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:42.604686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a988-0396-44f7-96e2-f1ad369ec214 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.604686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a988-0396-44f7-96e2-f1ad369ec214 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.604686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3985a988-0396-44f7-96e2-f1ad369ec214 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.605550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 457/909] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:42.611888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d2f4-2aad-4e7a-adea-4c622f066db0 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.612519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d2f4-2aad-4e7a-adea-4c622f066db0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.613040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d2f4-2aad-4e7a-adea-4c622f066db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.634030 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-0584d2f4-2aad-4e7a-adea-4c622f066db0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:42.635671 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0584d2f4-2aad-4e7a-adea-4c622f066db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:42.666736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 453/910] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:42 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:42.690905 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed0aae-9d2b-46cb-9ccc-3474d57eac97 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.700424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed0aae-9d2b-46cb-9ccc-3474d57eac97 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.702024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 458/911] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:42 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:42.710646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ed5e6-8cb3-4e65-b2a4-d2a5df4bba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.711205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ed5e6-8cb3-4e65-b2a4-d2a5df4bba3e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.711485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ed5e6-8cb3-4e65-b2a4-d2a5df4bba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.711753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843ed5e6-8cb3-4e65-b2a4-d2a5df4bba3e admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.712433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ed5e6-8cb3-4e65-b2a4-d2a5df4bba3e admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.714158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843ed5e6-8cb3-4e65-b2a4-d2a5df4bba3e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.729127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-843ed5e6-8cb3-4e65-b2a4-d2a5df4bba3e admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 13 16:36:42.730606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584d2f4-2aad-4e7a-adea-4c622f066db0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.730719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 454/912] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:42.737836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ed5e6-8cb3-4e65-b2a4-d2a5df4bba3e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.740052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584d2f4-2aad-4e7a-adea-4c622f066db0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.745907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146bf30-8184-4d9f-9217-eebeb78a62ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.746781 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bf30-8184-4d9f-9217-eebeb78a62ee admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.747070 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bf30-8184-4d9f-9217-eebeb78a62ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.747347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146bf30-8184-4d9f-9217-eebeb78a62ee admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.747666 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843ed5e6-8cb3-4e65-b2a4-d2a5df4bba3e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.748022 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146bf30-8184-4d9f-9217-eebeb78a62ee admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.749962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146bf30-8184-4d9f-9217-eebeb78a62ee admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.755829 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d23d5-d625-4196-9a1e-154518b885b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.756539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d23d5-d625-4196-9a1e-154518b885b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.756895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d23d5-d625-4196-9a1e-154518b885b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.756895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d23d5-d625-4196-9a1e-154518b885b0 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.757877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d23d5-d625-4196-9a1e-154518b885b0 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:42.758178 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d23d5-d625-4196-9a1e-154518b885b0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.759755 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d23d5-d625-4196-9a1e-154518b885b0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.761785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-d146bf30-8184-4d9f-9217-eebeb78a62ee admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 13 16:36:42.763146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 459/913] 10.222.0.62 () {56 vars in 1153 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:42.768286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 455/914] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:42.769688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146bf30-8184-4d9f-9217-eebeb78a62ee admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.774989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d23d5-d625-4196-9a1e-154518b885b0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.783119 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146bf30-8184-4d9f-9217-eebeb78a62ee admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.785572 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d23d5-d625-4196-9a1e-154518b885b0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.787772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9e98e-4cc1-4bb3-a1aa-c198ac5ba108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.788601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9e98e-4cc1-4bb3-a1aa-c198ac5ba108 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.788842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9e98e-4cc1-4bb3-a1aa-c198ac5ba108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.789119 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9e98e-4cc1-4bb3-a1aa-c198ac5ba108 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.789841 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9e98e-4cc1-4bb3-a1aa-c198ac5ba108 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:42.790133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9e98e-4cc1-4bb3-a1aa-c198ac5ba108 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.791731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9e98e-4cc1-4bb3-a1aa-c198ac5ba108 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.792986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae15e-2e2f-483c-9cc3-845bdc12a457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.794006 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae15e-2e2f-483c-9cc3-845bdc12a457 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.794492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae15e-2e2f-483c-9cc3-845bdc12a457 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.794996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae15e-2e2f-483c-9cc3-845bdc12a457 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.795998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae15e-2e2f-483c-9cc3-845bdc12a457 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:42.796520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae15e-2e2f-483c-9cc3-845bdc12a457 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.796948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 460/915] 10.222.0.62 () {56 vars in 1147 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:42.798652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae15e-2e2f-483c-9cc3-845bdc12a457 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.802548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9e98e-4cc1-4bb3-a1aa-c198ac5ba108 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.805802 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 456/916] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:42.812375 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae15e-2e2f-483c-9cc3-845bdc12a457 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.812501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9e98e-4cc1-4bb3-a1aa-c198ac5ba108 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.821233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b54b7-f966-4dcd-ad96-d63f072b4f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.822058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b54b7-f966-4dcd-ad96-d63f072b4f9f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.822409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b54b7-f966-4dcd-ad96-d63f072b4f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.822796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b54b7-f966-4dcd-ad96-d63f072b4f9f admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.823046 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae15e-2e2f-483c-9cc3-845bdc12a457 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.823659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b54b7-f966-4dcd-ad96-d63f072b4f9f admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:42.824035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b54b7-f966-4dcd-ad96-d63f072b4f9f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.825938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b54b7-f966-4dcd-ad96-d63f072b4f9f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.828057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bbe16-25e5-4f87-9ab1-92c5965ebb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.828887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bbe16-25e5-4f87-9ab1-92c5965ebb10 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.829297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bbe16-25e5-4f87-9ab1-92c5965ebb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.829719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bbe16-25e5-4f87-9ab1-92c5965ebb10 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.830658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bbe16-25e5-4f87-9ab1-92c5965ebb10 admin admin] RBAC: Adding query filter params (interface=public, service_id=230a7d569b3e4123bd63fa2c94c87925, region_id=RegionOne) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:42.831117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bbe16-25e5-4f87-9ab1-92c5965ebb10 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.832119 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 461/917] 10.222.0.62 () {56 vars in 1147 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:42.833175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bbe16-25e5-4f87-9ab1-92c5965ebb10 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.838374 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b54b7-f966-4dcd-ad96-d63f072b4f9f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.844714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 457/918] 10.222.0.62 () {56 vars in 1272 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/endpoints?service_id=230a7d569b3e4123bd63fa2c94c87925&interface=public®ion_id=RegionOne => generated 194 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:42.846534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bbe16-25e5-4f87-9ab1-92c5965ebb10 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.849358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b54b7-f966-4dcd-ad96-d63f072b4f9f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.854929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c0732-9d69-4881-8c28-239ab4b3d5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.855371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0732-9d69-4881-8c28-239ab4b3d5bb admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.856026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0732-9d69-4881-8c28-239ab4b3d5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.856026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c0732-9d69-4881-8c28-239ab4b3d5bb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.857447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c0732-9d69-4881-8c28-239ab4b3d5bb admin admin] RBAC: Adding query filter params (interface=public, service_id=7e7f5bfe132047afb01f4981dbfbfc19, region_id=RegionOne) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:42.857447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c0732-9d69-4881-8c28-239ab4b3d5bb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.858762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c0732-9d69-4881-8c28-239ab4b3d5bb admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.864431 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 462/919] 10.222.0.62 () {56 vars in 1272 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/endpoints?service_id=7e7f5bfe132047afb01f4981dbfbfc19&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:42.865701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bbe16-25e5-4f87-9ab1-92c5965ebb10 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.870523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c0732-9d69-4881-8c28-239ab4b3d5bb admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:42.872874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cd440-f925-4263-8b7b-37a3b9bd6782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.873897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd440-f925-4263-8b7b-37a3b9bd6782 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.874390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd440-f925-4263-8b7b-37a3b9bd6782 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.874883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cd440-f925-4263-8b7b-37a3b9bd6782 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.876077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cd440-f925-4263-8b7b-37a3b9bd6782 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.878867 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cd440-f925-4263-8b7b-37a3b9bd6782 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.880127 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c0732-9d69-4881-8c28-239ab4b3d5bb admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:42.884628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdfec4-480f-4755-9995-8ed25d7a530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:42.885284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdfec4-480f-4755-9995-8ed25d7a530d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:42.885558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdfec4-480f-4755-9995-8ed25d7a530d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:42.885826 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdfec4-480f-4755-9995-8ed25d7a530d admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:42.886514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdfec4-480f-4755-9995-8ed25d7a530d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:42.892633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdfec4-480f-4755-9995-8ed25d7a530d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:42.892892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 458/920] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/services => generated 1268 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:36:42.898708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 463/921] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Dec 13 16:36:42 2021] GET /identity/v3/services => generated 1268 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:36:43.368288 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338144e-f35a-4b5f-825b-fdb15d8a37c7 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:43.368850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338144e-f35a-4b5f-825b-fdb15d8a37c7 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:43.368850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338144e-f35a-4b5f-825b-fdb15d8a37c7 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:43.370811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 459/922] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:43.376823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4cf87-447c-426c-9081-ba0a6552c08f None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:43.377656 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4cf87-447c-426c-9081-ba0a6552c08f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:43.378123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4cf87-447c-426c-9081-ba0a6552c08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:43.397146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-6de4cf87-447c-426c-9081-ba0a6552c08f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:43.399278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6de4cf87-447c-426c-9081-ba0a6552c08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:43.407514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 464/923] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:43 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:43.430931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338144e-f35a-4b5f-825b-fdb15d8a37c7 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:43.443138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338144e-f35a-4b5f-825b-fdb15d8a37c7 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:43.447827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ca719-f1f4-4ff9-8872-bf269d8bf623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:43.448525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ca719-f1f4-4ff9-8872-bf269d8bf623 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:43.448870 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ca719-f1f4-4ff9-8872-bf269d8bf623 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:43.449142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ca719-f1f4-4ff9-8872-bf269d8bf623 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:43.450158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ca719-f1f4-4ff9-8872-bf269d8bf623 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:43.451751 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ca719-f1f4-4ff9-8872-bf269d8bf623 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:43.468047 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 460/924] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:36:43 2021] POST /identity/v3/services => generated 241 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:44.883042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9843b30-8a0e-4967-a14c-1a9337515427 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:44.883736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9843b30-8a0e-4967-a14c-1a9337515427 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:44.883736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9843b30-8a0e-4967-a14c-1a9337515427 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:44.885658 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 465/925] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:44.892051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0d764-05a4-49ce-9eb5-178bc21ab5f2 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:44.892466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0d764-05a4-49ce-9eb5-178bc21ab5f2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:44.892655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a0d764-05a4-49ce-9eb5-178bc21ab5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:44.911459 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f8a0d764-05a4-49ce-9eb5-178bc21ab5f2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:44.912784 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f8a0d764-05a4-49ce-9eb5-178bc21ab5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:44.930462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 461/926] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:44 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:44.954755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9843b30-8a0e-4967-a14c-1a9337515427 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:44.967065 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9843b30-8a0e-4967-a14c-1a9337515427 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:44.971333 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f96e0c-b2ac-4eb3-b305-2e40afdb3dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:44.972131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f96e0c-b2ac-4eb3-b305-2e40afdb3dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:44.972403 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f96e0c-b2ac-4eb3-b305-2e40afdb3dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:44.972692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f96e0c-b2ac-4eb3-b305-2e40afdb3dc2 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:44.983953 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f96e0c-b2ac-4eb3-b305-2e40afdb3dc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:44.991483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-29f96e0c-b2ac-4eb3-b305-2e40afdb3dc2 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 13 16:36:44.993110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 466/927] 10.222.0.62 () {56 vars in 1141 bytes} [Mon Dec 13 16:36:44 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:44.999811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0d764-05a4-49ce-9eb5-178bc21ab5f2 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.009507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a0d764-05a4-49ce-9eb5-178bc21ab5f2 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.014176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f06e87-de9a-41c6-a9fb-d73d0785875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.015188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f06e87-de9a-41c6-a9fb-d73d0785875b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.015463 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f06e87-de9a-41c6-a9fb-d73d0785875b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.015746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f06e87-de9a-41c6-a9fb-d73d0785875b admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.016486 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f06e87-de9a-41c6-a9fb-d73d0785875b admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:45.016810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f06e87-de9a-41c6-a9fb-d73d0785875b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.018420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f06e87-de9a-41c6-a9fb-d73d0785875b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.027775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 462/928] 10.222.0.62 () {56 vars in 1136 bytes} [Mon Dec 13 16:36:44 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:45.033980 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f96e0c-b2ac-4eb3-b305-2e40afdb3dc2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.044120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f96e0c-b2ac-4eb3-b305-2e40afdb3dc2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.048559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7b0bc-c98c-493f-9b7b-c45851b09a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.049372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7b0bc-c98c-493f-9b7b-c45851b09a23 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.049647 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7b0bc-c98c-493f-9b7b-c45851b09a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.049915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7b0bc-c98c-493f-9b7b-c45851b09a23 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.065053 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7b0bc-c98c-493f-9b7b-c45851b09a23 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.066906 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7b0bc-c98c-493f-9b7b-c45851b09a23 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.083310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-ddb7b0bc-c98c-493f-9b7b-c45851b09a23 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:45.085027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 467/929] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:45.090827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f06e87-de9a-41c6-a9fb-d73d0785875b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.100597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f06e87-de9a-41c6-a9fb-d73d0785875b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.105183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde96799-0f33-429b-af7c-fec04b4d1777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.105952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde96799-0f33-429b-af7c-fec04b4d1777 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.106238 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde96799-0f33-429b-af7c-fec04b4d1777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.106499 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde96799-0f33-429b-af7c-fec04b4d1777 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.107381 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde96799-0f33-429b-af7c-fec04b4d1777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:45.107685 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde96799-0f33-429b-af7c-fec04b4d1777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.109330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde96799-0f33-429b-af7c-fec04b4d1777 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.121987 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 463/930] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:45.128041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7b0bc-c98c-493f-9b7b-c45851b09a23 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.138063 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7b0bc-c98c-493f-9b7b-c45851b09a23 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.142777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63247b7a-cc52-4b1a-a31c-63dd81cf29c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.143578 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63247b7a-cc52-4b1a-a31c-63dd81cf29c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.143858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63247b7a-cc52-4b1a-a31c-63dd81cf29c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.144133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63247b7a-cc52-4b1a-a31c-63dd81cf29c6 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.152706 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63247b7a-cc52-4b1a-a31c-63dd81cf29c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.154721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63247b7a-cc52-4b1a-a31c-63dd81cf29c6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.168463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-63247b7a-cc52-4b1a-a31c-63dd81cf29c6 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Dec 13 16:36:45.170024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 468/931] 10.222.0.62 () {56 vars in 1138 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:45.176237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde96799-0f33-429b-af7c-fec04b4d1777 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.186278 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde96799-0f33-429b-af7c-fec04b4d1777 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.190974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67235a31-b943-428c-9207-4109580b87d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.191900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67235a31-b943-428c-9207-4109580b87d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.192381 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67235a31-b943-428c-9207-4109580b87d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.192870 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67235a31-b943-428c-9207-4109580b87d3 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.194006 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67235a31-b943-428c-9207-4109580b87d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:45.194693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67235a31-b943-428c-9207-4109580b87d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.197349 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67235a31-b943-428c-9207-4109580b87d3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.216136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 464/932] 10.222.0.62 () {56 vars in 1170 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:45.222332 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63247b7a-cc52-4b1a-a31c-63dd81cf29c6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.232162 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63247b7a-cc52-4b1a-a31c-63dd81cf29c6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.237310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a9603-ee2d-4f7f-9d18-9e134a52f946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.238225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9603-ee2d-4f7f-9d18-9e134a52f946 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.238740 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9603-ee2d-4f7f-9d18-9e134a52f946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.239195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a9603-ee2d-4f7f-9d18-9e134a52f946 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.248278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a9603-ee2d-4f7f-9d18-9e134a52f946 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.250533 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a9603-ee2d-4f7f-9d18-9e134a52f946 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.260315 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 469/933] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/auth/tokens => generated 1765 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:36:45.267183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67235a31-b943-428c-9207-4109580b87d3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.277630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67235a31-b943-428c-9207-4109580b87d3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.282352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a98829-7a7d-495e-bda6-4b4c4a77d25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.283426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a98829-7a7d-495e-bda6-4b4c4a77d25d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.283942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a98829-7a7d-495e-bda6-4b4c4a77d25d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.284402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a98829-7a7d-495e-bda6-4b4c4a77d25d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.295328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a98829-7a7d-495e-bda6-4b4c4a77d25d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.297522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a98829-7a7d-495e-bda6-4b4c4a77d25d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.314614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-c4a98829-7a7d-495e-bda6-4b4c4a77d25d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:45.316387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 465/934] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:45.323746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a9603-ee2d-4f7f-9d18-9e134a52f946 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.332945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a9603-ee2d-4f7f-9d18-9e134a52f946 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.338138 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31735b-1638-48ea-b5a6-2460e3941d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.339076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31735b-1638-48ea-b5a6-2460e3941d44 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.339543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31735b-1638-48ea-b5a6-2460e3941d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.340079 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a31735b-1638-48ea-b5a6-2460e3941d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.341056 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31735b-1638-48ea-b5a6-2460e3941d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:45.341581 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31735b-1638-48ea-b5a6-2460e3941d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.343403 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a31735b-1638-48ea-b5a6-2460e3941d44 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.357660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 470/935] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:45.361319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786cba3-380e-4236-9f44-31ae56247747 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.361319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786cba3-380e-4236-9f44-31ae56247747 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.361319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786cba3-380e-4236-9f44-31ae56247747 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.363177 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 466/936] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:45.364318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31735b-1638-48ea-b5a6-2460e3941d44 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.367153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ffbb-4134-469c-9de7-6c6cca138bd7 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.367442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ffbb-4134-469c-9de7-6c6cca138bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.367717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942ffbb-4134-469c-9de7-6c6cca138bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.378381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a31735b-1638-48ea-b5a6-2460e3941d44 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.385626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c89cc9-8247-46c0-865e-b94abbcb22fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.386741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c89cc9-8247-46c0-865e-b94abbcb22fa admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.387192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c89cc9-8247-46c0-865e-b94abbcb22fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.387634 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c89cc9-8247-46c0-865e-b94abbcb22fa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.390311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7942ffbb-4134-469c-9de7-6c6cca138bd7 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:45.391503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7942ffbb-4134-469c-9de7-6c6cca138bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:45.396629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c89cc9-8247-46c0-865e-b94abbcb22fa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.399188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c89cc9-8247-46c0-865e-b94abbcb22fa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.400612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 467/937] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:45 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:45.412029 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279cb32-5f97-465a-9d06-0ac52d126a62 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.412315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279cb32-5f97-465a-9d06-0ac52d126a62 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.412974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279cb32-5f97-465a-9d06-0ac52d126a62 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.414991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 468/938] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:45.420233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e1f66-5ae1-4071-87cc-a50c41197a13 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.420514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e1f66-5ae1-4071-87cc-a50c41197a13 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.420930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e1f66-5ae1-4071-87cc-a50c41197a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.421252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-32c89cc9-8247-46c0-865e-b94abbcb22fa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:45.422974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 471/939] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:45.427465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c89cc9-8247-46c0-865e-b94abbcb22fa admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.438381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c89cc9-8247-46c0-865e-b94abbcb22fa admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.438999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-e40e1f66-5ae1-4071-87cc-a50c41197a13 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:45.440152 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e40e1f66-5ae1-4071-87cc-a50c41197a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:45.443020 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4414d-463f-40ba-bdf9-a3254e57fbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.443982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4414d-463f-40ba-bdf9-a3254e57fbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.444271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4414d-463f-40ba-bdf9-a3254e57fbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.444603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4414d-463f-40ba-bdf9-a3254e57fbe8 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.445294 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4414d-463f-40ba-bdf9-a3254e57fbe8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.446887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4414d-463f-40ba-bdf9-a3254e57fbe8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.448016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 469/940] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:45 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:45.450140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e1f66-5ae1-4071-87cc-a50c41197a13 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.459252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-c1a4414d-463f-40ba-bdf9-a3254e57fbe8 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Dec 13 16:36:45.460203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e1f66-5ae1-4071-87cc-a50c41197a13 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.460684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 472/941] 10.222.0.62 () {56 vars in 1153 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:45.465339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bdeba-f604-4aea-815a-387fccfb2634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.466272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bdeba-f604-4aea-815a-387fccfb2634 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.466694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bdeba-f604-4aea-815a-387fccfb2634 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.466969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bdeba-f604-4aea-815a-387fccfb2634 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.467795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bdeba-f604-4aea-815a-387fccfb2634 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:45.468112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bdeba-f604-4aea-815a-387fccfb2634 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.468537 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4414d-463f-40ba-bdf9-a3254e57fbe8 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.470276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bdeba-f604-4aea-815a-387fccfb2634 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.486197 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4414d-463f-40ba-bdf9-a3254e57fbe8 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.489724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 470/942] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:45.490658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bdeba-f604-4aea-815a-387fccfb2634 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.498464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a5dbc-c185-4dbb-9ca3-cda6fe284db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.499243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a5dbc-c185-4dbb-9ca3-cda6fe284db1 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.499587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a5dbc-c185-4dbb-9ca3-cda6fe284db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.499919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a5dbc-c185-4dbb-9ca3-cda6fe284db1 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.500750 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a5dbc-c185-4dbb-9ca3-cda6fe284db1 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:45.501120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a5dbc-c185-4dbb-9ca3-cda6fe284db1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.502821 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a5dbc-c185-4dbb-9ca3-cda6fe284db1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.503541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bdeba-f604-4aea-815a-387fccfb2634 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.508266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 473/943] 10.222.0.62 () {56 vars in 1147 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:45.509918 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ac930-0289-40c8-a616-b6ae1dab7acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.510791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac930-0289-40c8-a616-b6ae1dab7acb admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.511136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac930-0289-40c8-a616-b6ae1dab7acb admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.511470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac930-0289-40c8-a616-b6ae1dab7acb admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.512214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ac930-0289-40c8-a616-b6ae1dab7acb admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.513845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a5dbc-c185-4dbb-9ca3-cda6fe284db1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.513959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ac930-0289-40c8-a616-b6ae1dab7acb admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.523417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a5dbc-c185-4dbb-9ca3-cda6fe284db1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.526881 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-342ac930-0289-40c8-a616-b6ae1dab7acb admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Dec 13 16:36:45.527718 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de0f51-dbde-4ce8-a302-723f39d785b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.528355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 471/944] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:45.528452 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de0f51-dbde-4ce8-a302-723f39d785b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.528708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de0f51-dbde-4ce8-a302-723f39d785b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.528983 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de0f51-dbde-4ce8-a302-723f39d785b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.529870 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de0f51-dbde-4ce8-a302-723f39d785b2 admin admin] RBAC: Adding query filter params (role.id=3e6310c0228e4643a7cd784cdf3aca43, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=a541eff61b694cfab57bd9be29628a25) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:45.530176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de0f51-dbde-4ce8-a302-723f39d785b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.531991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de0f51-dbde-4ce8-a302-723f39d785b2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.534473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ac930-0289-40c8-a616-b6ae1dab7acb admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.538536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 474/945] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/role_assignments?user.id=a541eff61b694cfab57bd9be29628a25&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=3e6310c0228e4643a7cd784cdf3aca43 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:45.544992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ac930-0289-40c8-a616-b6ae1dab7acb admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.556779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de0f51-dbde-4ce8-a302-723f39d785b2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.557646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1e97e-0a82-4a13-baa5-04cf88fbfd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.558351 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1e97e-0a82-4a13-baa5-04cf88fbfd52 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.558712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1e97e-0a82-4a13-baa5-04cf88fbfd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.559041 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1e97e-0a82-4a13-baa5-04cf88fbfd52 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.559837 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1e97e-0a82-4a13-baa5-04cf88fbfd52 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:45.560143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1e97e-0a82-4a13-baa5-04cf88fbfd52 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.562015 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b1e97e-0a82-4a13-baa5-04cf88fbfd52 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.566708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de0f51-dbde-4ce8-a302-723f39d785b2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.570813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 472/946] 10.222.0.62 () {56 vars in 1147 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:45.577347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82f863-832f-474a-a4eb-819e54ff2f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.577834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1e97e-0a82-4a13-baa5-04cf88fbfd52 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.578035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f863-832f-474a-a4eb-819e54ff2f20 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.578320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f863-832f-474a-a4eb-819e54ff2f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.578594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82f863-832f-474a-a4eb-819e54ff2f20 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.579419 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82f863-832f-474a-a4eb-819e54ff2f20 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:45.579723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82f863-832f-474a-a4eb-819e54ff2f20 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.581376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b82f863-832f-474a-a4eb-819e54ff2f20 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.586996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 475/947] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:45.590574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1e97e-0a82-4a13-baa5-04cf88fbfd52 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.593531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82f863-832f-474a-a4eb-819e54ff2f20 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.596549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b049a4ab-fd74-4d39-9041-2bb763a15012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.597252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049a4ab-fd74-4d39-9041-2bb763a15012 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.597578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049a4ab-fd74-4d39-9041-2bb763a15012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.597850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b049a4ab-fd74-4d39-9041-2bb763a15012 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.598718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049a4ab-fd74-4d39-9041-2bb763a15012 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.599790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-b049a4ab-fd74-4d39-9041-2bb763a15012 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:36:45.599790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:36:45.599790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:36:45.604751 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b82f863-832f-474a-a4eb-819e54ff2f20 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.605463 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b049a4ab-fd74-4d39-9041-2bb763a15012 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.609811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bbec9-733e-439b-8b1c-9b1fd5b380b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.610719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bbec9-733e-439b-8b1c-9b1fd5b380b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.611170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bbec9-733e-439b-8b1c-9b1fd5b380b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.611608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bbec9-733e-439b-8b1c-9b1fd5b380b8 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.612521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bbec9-733e-439b-8b1c-9b1fd5b380b8 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:45.613047 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bbec9-733e-439b-8b1c-9b1fd5b380b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.614853 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bbec9-733e-439b-8b1c-9b1fd5b380b8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.623718 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 476/948] 10.222.0.62 () {56 vars in 1135 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:45.633347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bbec9-733e-439b-8b1c-9b1fd5b380b8 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.644689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 473/949] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Dec 13 16:36:45 2021] POST /identity/v3/endpoints => generated 347 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:36:45.646547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bbec9-733e-439b-8b1c-9b1fd5b380b8 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.666434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aeb0c2-3a48-4037-9a4a-4b0417cbcad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.667203 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeb0c2-3a48-4037-9a4a-4b0417cbcad5 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.667544 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeb0c2-3a48-4037-9a4a-4b0417cbcad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.667820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeb0c2-3a48-4037-9a4a-4b0417cbcad5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.668765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aeb0c2-3a48-4037-9a4a-4b0417cbcad5 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.670663 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aeb0c2-3a48-4037-9a4a-4b0417cbcad5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:45.696655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 477/950] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Dec 13 16:36:45 2021] POST /identity/v3/endpoints => generated 346 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:45.893127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f60a-3c9c-4888-a55a-b424e8e1d5bf None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.893677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f60a-3c9c-4888-a55a-b424e8e1d5bf None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.893677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af9f60a-3c9c-4888-a55a-b424e8e1d5bf None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.895598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 474/951] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:45.902388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ecad2-7189-4e03-b942-f8d01028a0b2 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.902923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ecad2-7189-4e03-b942-f8d01028a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.902923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ecad2-7189-4e03-b942-f8d01028a0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.924163 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-fa1ecad2-7189-4e03-b942-f8d01028a0b2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:45.925738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fa1ecad2-7189-4e03-b942-f8d01028a0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:45.944940 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 478/952] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:45 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:45.975332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f60a-3c9c-4888-a55a-b424e8e1d5bf None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:45.989885 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af9f60a-3c9c-4888-a55a-b424e8e1d5bf None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:45.995520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98731d4e-6c97-43f7-9335-2916e86d0d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:45.996332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98731d4e-6c97-43f7-9335-2916e86d0d60 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:45.996639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98731d4e-6c97-43f7-9335-2916e86d0d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:45.996922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98731d4e-6c97-43f7-9335-2916e86d0d60 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:45.997601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98731d4e-6c97-43f7-9335-2916e86d0d60 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:45.999210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98731d4e-6c97-43f7-9335-2916e86d0d60 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:46.011011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-98731d4e-6c97-43f7-9335-2916e86d0d60 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 13 16:36:46.012541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 475/953] 10.222.0.62 () {56 vars in 1147 bytes} [Mon Dec 13 16:36:45 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:46.020217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ecad2-7189-4e03-b942-f8d01028a0b2 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:46.030078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ecad2-7189-4e03-b942-f8d01028a0b2 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:46.036720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109599cd-a0f5-4c6f-8abb-78d87e77053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:46.039531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109599cd-a0f5-4c6f-8abb-78d87e77053a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:46.039815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109599cd-a0f5-4c6f-8abb-78d87e77053a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:46.040094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109599cd-a0f5-4c6f-8abb-78d87e77053a admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:46.040862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109599cd-a0f5-4c6f-8abb-78d87e77053a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:46.041171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109599cd-a0f5-4c6f-8abb-78d87e77053a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:46.042911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109599cd-a0f5-4c6f-8abb-78d87e77053a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:46.048659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 479/954] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Dec 13 16:36:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:46.055114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98731d4e-6c97-43f7-9335-2916e86d0d60 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:46.065223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98731d4e-6c97-43f7-9335-2916e86d0d60 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:46.070308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cdf64-896f-43f1-a09b-0df0f7fb9b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:46.070968 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cdf64-896f-43f1-a09b-0df0f7fb9b00 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:46.071287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cdf64-896f-43f1-a09b-0df0f7fb9b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:46.071569 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cdf64-896f-43f1-a09b-0df0f7fb9b00 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:46.072298 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cdf64-896f-43f1-a09b-0df0f7fb9b00 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:46.072676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cdf64-896f-43f1-a09b-0df0f7fb9b00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:46.074358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913cdf64-896f-43f1-a09b-0df0f7fb9b00 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:46.080065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 476/955] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Dec 13 16:36:46 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:46.086591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109599cd-a0f5-4c6f-8abb-78d87e77053a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:46.096793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109599cd-a0f5-4c6f-8abb-78d87e77053a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:46.102155 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71970a3a-b3d3-4f14-9e69-02e099bc7714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:46.102822 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970a3a-b3d3-4f14-9e69-02e099bc7714 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:46.103105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970a3a-b3d3-4f14-9e69-02e099bc7714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:46.103432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71970a3a-b3d3-4f14-9e69-02e099bc7714 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:46.104239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71970a3a-b3d3-4f14-9e69-02e099bc7714 admin admin] RBAC: Adding query filter params (interface=public, service_id=a7674c9115ee4186ab661a333a21dc1f, region_id=RegionOne) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:46.104633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71970a3a-b3d3-4f14-9e69-02e099bc7714 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:46.106418 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71970a3a-b3d3-4f14-9e69-02e099bc7714 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:46.112478 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 480/956] 10.222.0.62 () {56 vars in 1272 bytes} [Mon Dec 13 16:36:46 2021] GET /identity/v3/endpoints?service_id=a7674c9115ee4186ab661a333a21dc1f&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:46.118851 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cdf64-896f-43f1-a09b-0df0f7fb9b00 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:46.128977 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cdf64-896f-43f1-a09b-0df0f7fb9b00 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:46.134322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c8d8a3-4768-4826-ae33-30a2c68fa9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:46.135031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8d8a3-4768-4826-ae33-30a2c68fa9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:46.135313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8d8a3-4768-4826-ae33-30a2c68fa9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:46.135587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c8d8a3-4768-4826-ae33-30a2c68fa9c8 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:46.136330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8d8a3-4768-4826-ae33-30a2c68fa9c8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:46.138010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c8d8a3-4768-4826-ae33-30a2c68fa9c8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:46.145036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 477/957] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Dec 13 16:36:46 2021] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:36:47.988790 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5652c-75f2-4294-8e91-fdbabbe973af None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:47.989524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5652c-75f2-4294-8e91-fdbabbe973af None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:47.989524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5652c-75f2-4294-8e91-fdbabbe973af None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:47.991494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 481/958] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:47.997561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916c62-9bec-4578-ba99-8581e4b7c483 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:47.998086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916c62-9bec-4578-ba99-8581e4b7c483 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:47.998086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75916c62-9bec-4578-ba99-8581e4b7c483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.016330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-75916c62-9bec-4578-ba99-8581e4b7c483 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:48.017555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-75916c62-9bec-4578-ba99-8581e4b7c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:48.026007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 478/959] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:47 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:48.048947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5652c-75f2-4294-8e91-fdbabbe973af None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.061599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5652c-75f2-4294-8e91-fdbabbe973af None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.066218 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e88121-6ec7-456e-b8bb-78cd9f1f2640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.067006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e88121-6ec7-456e-b8bb-78cd9f1f2640 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.067287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e88121-6ec7-456e-b8bb-78cd9f1f2640 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.067562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e88121-6ec7-456e-b8bb-78cd9f1f2640 admin admin] PATH_INFO: `/v3/services/image` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.068224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e88121-6ec7-456e-b8bb-78cd9f1f2640 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.070060 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e88121-6ec7-456e-b8bb-78cd9f1f2640 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.081620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-07e88121-6ec7-456e-b8bb-78cd9f1f2640 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 13 16:36:48.083136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 482/960] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Dec 13 16:36:48 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:48.093904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75916c62-9bec-4578-ba99-8581e4b7c483 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.103554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75916c62-9bec-4578-ba99-8581e4b7c483 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.108634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cdca90-39be-4547-8c24-e1b7d31707f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.109343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdca90-39be-4547-8c24-e1b7d31707f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.109620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdca90-39be-4547-8c24-e1b7d31707f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.109893 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cdca90-39be-4547-8c24-e1b7d31707f8 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.110641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdca90-39be-4547-8c24-e1b7d31707f8 admin admin] RBAC: Adding query filter params (name=image) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:48.110949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdca90-39be-4547-8c24-e1b7d31707f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.112651 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cdca90-39be-4547-8c24-e1b7d31707f8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.118645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 479/961] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:48 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:48.125033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e88121-6ec7-456e-b8bb-78cd9f1f2640 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.135628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e88121-6ec7-456e-b8bb-78cd9f1f2640 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.140651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6d4bb-c863-4c22-8d15-d618d0f9ca00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.141323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6d4bb-c863-4c22-8d15-d618d0f9ca00 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.141604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6d4bb-c863-4c22-8d15-d618d0f9ca00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.141880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6d4bb-c863-4c22-8d15-d618d0f9ca00 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.142662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6d4bb-c863-4c22-8d15-d618d0f9ca00 admin admin] RBAC: Adding query filter params (type=image) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:48.142972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6d4bb-c863-4c22-8d15-d618d0f9ca00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.144607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6d4bb-c863-4c22-8d15-d618d0f9ca00 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.147247 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b039d-a589-4289-bad2-b9042b5c2bc6 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.147485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b039d-a589-4289-bad2-b9042b5c2bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.147650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b039d-a589-4289-bad2-b9042b5c2bc6 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.149819 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 480/962] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:48.150327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 483/963] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:48 2021] GET /identity/v3/services?type=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:48.155891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d0bad-37fc-4c4c-a211-8a717ada625d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.156175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d0bad-37fc-4c4c-a211-8a717ada625d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.156442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d0bad-37fc-4c4c-a211-8a717ada625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.177342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-dd0d0bad-37fc-4c4c-a211-8a717ada625d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:48.178817 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-dd0d0bad-37fc-4c4c-a211-8a717ada625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:48.187356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 481/964] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:48 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:48.193780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacf5ce-3786-467b-b847-ab904306ec56 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.194164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacf5ce-3786-467b-b847-ab904306ec56 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.194345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdacf5ce-3786-467b-b847-ab904306ec56 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.196667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 484/965] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:48.202846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d739a6-80e9-48b9-90e0-d66192db126a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.203134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d739a6-80e9-48b9-90e0-d66192db126a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.203412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d739a6-80e9-48b9-90e0-d66192db126a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.213519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacf5ce-3786-467b-b847-ab904306ec56 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.223313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c1d739a6-80e9-48b9-90e0-d66192db126a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:48.224553 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c1d739a6-80e9-48b9-90e0-d66192db126a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:48.227219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdacf5ce-3786-467b-b847-ab904306ec56 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.232153 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24cc42-c240-4b3b-8f72-61a7f6074d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.233341 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24cc42-c240-4b3b-8f72-61a7f6074d44 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.240823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 482/966] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:48 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:48.241011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24cc42-c240-4b3b-8f72-61a7f6074d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.241011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c24cc42-c240-4b3b-8f72-61a7f6074d44 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.241011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24cc42-c240-4b3b-8f72-61a7f6074d44 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.241011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c24cc42-c240-4b3b-8f72-61a7f6074d44 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.251447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-9c24cc42-c240-4b3b-8f72-61a7f6074d44 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 13 16:36:48.253086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 485/967] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:48 2021] GET /identity/v3/services/compute => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:48.259912 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d739a6-80e9-48b9-90e0-d66192db126a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.269647 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24cc42-c240-4b3b-8f72-61a7f6074d44 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.270803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d739a6-80e9-48b9-90e0-d66192db126a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.275489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2443138-561c-4565-afbd-c31296dcfbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.276174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2443138-561c-4565-afbd-c31296dcfbed admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.276456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2443138-561c-4565-afbd-c31296dcfbed admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.276762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2443138-561c-4565-afbd-c31296dcfbed admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.277499 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2443138-561c-4565-afbd-c31296dcfbed admin admin] RBAC: Adding query filter params (name=compute) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:48.277800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2443138-561c-4565-afbd-c31296dcfbed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.279434 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2443138-561c-4565-afbd-c31296dcfbed admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.282256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c24cc42-c240-4b3b-8f72-61a7f6074d44 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.290553 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 483/968] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:48 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:48.290747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040078-1b62-4573-857f-b241a40a0619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.291490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040078-1b62-4573-857f-b241a40a0619 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.291703 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040078-1b62-4573-857f-b241a40a0619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.291974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6040078-1b62-4573-857f-b241a40a0619 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.292728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6040078-1b62-4573-857f-b241a40a0619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.293840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2443138-561c-4565-afbd-c31296dcfbed admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.294745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6040078-1b62-4573-857f-b241a40a0619 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.296304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.common [None req-d6040078-1b62-4573-857f-b241a40a0619 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 13 16:36:48.304801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2443138-561c-4565-afbd-c31296dcfbed admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.310376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cda75c-98aa-4c10-97e5-b0f45b9104da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.311410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cda75c-98aa-4c10-97e5-b0f45b9104da admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.311889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cda75c-98aa-4c10-97e5-b0f45b9104da admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.312369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cda75c-98aa-4c10-97e5-b0f45b9104da admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.313346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cda75c-98aa-4c10-97e5-b0f45b9104da admin admin] RBAC: Adding query filter params (type=compute) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:48.313719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cda75c-98aa-4c10-97e5-b0f45b9104da admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.315419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cda75c-98aa-4c10-97e5-b0f45b9104da admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.324113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.sql.core [None req-d6040078-1b62-4573-857f-b241a40a0619 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Dec 13 16:36:48.324113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Dec 13 16:36:48.324113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [parameters: {'id': 'b7559a4574b8441f9f913e23aef25b5a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Dec 13 16:36:48.324113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86095) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 13 16:36:48.328724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 484/969] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:48 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:48.337984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-d6040078-1b62-4573-857f-b241a40a0619 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b7559a4574b8441f9f913e23aef25b5a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b7559a4574b8441f9f913e23aef25b5a. Dec 13 16:36:48.339982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 486/970] 10.222.0.62 () {60 vars in 1161 bytes} [Mon Dec 13 16:36:48 2021] POST /identity/v3/projects => generated 262 bytes in 71 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:48.347078 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cda75c-98aa-4c10-97e5-b0f45b9104da admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.357730 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cda75c-98aa-4c10-97e5-b0f45b9104da admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.363087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8e5b6-31cd-42fc-8de8-ea6ddf253be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.364120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e5b6-31cd-42fc-8de8-ea6ddf253be3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.364360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e5b6-31cd-42fc-8de8-ea6ddf253be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.364754 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e5b6-31cd-42fc-8de8-ea6ddf253be3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.373197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8e5b6-31cd-42fc-8de8-ea6ddf253be3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.375346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8e5b6-31cd-42fc-8de8-ea6ddf253be3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.391171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-31e8e5b6-31cd-42fc-8de8-ea6ddf253be3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:48.396732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 485/971] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:48.400274 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040078-1b62-4573-857f-b241a40a0619 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.411353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6040078-1b62-4573-857f-b241a40a0619 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.416708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee081689-8df5-46f2-921a-10c6732219bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.417697 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee081689-8df5-46f2-921a-10c6732219bb admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.418155 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee081689-8df5-46f2-921a-10c6732219bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.418634 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee081689-8df5-46f2-921a-10c6732219bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.419591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee081689-8df5-46f2-921a-10c6732219bb admin admin] RBAC: Adding query filter params (name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:48.420085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee081689-8df5-46f2-921a-10c6732219bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.422535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee081689-8df5-46f2-921a-10c6732219bb admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.446524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 487/972] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:48 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:48.539511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3498e4-6601-4ac7-8f89-640abdda0388 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.539749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3498e4-6601-4ac7-8f89-640abdda0388 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.540007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3498e4-6601-4ac7-8f89-640abdda0388 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.542480 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 486/973] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:48.551073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35246-4dbd-4834-bc46-dd846746d8b8 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.551383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35246-4dbd-4834-bc46-dd846746d8b8 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.551651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35246-4dbd-4834-bc46-dd846746d8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.571984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-70a35246-4dbd-4834-bc46-dd846746d8b8 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:48.573607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-70a35246-4dbd-4834-bc46-dd846746d8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:48.582034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 488/974] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:48 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:48.606617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3498e4-6601-4ac7-8f89-640abdda0388 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.619334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3498e4-6601-4ac7-8f89-640abdda0388 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.624663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6cdee-57b3-499b-b6c6-1c4eccfee1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.625491 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6cdee-57b3-499b-b6c6-1c4eccfee1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.625769 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6cdee-57b3-499b-b6c6-1c4eccfee1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.626036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6cdee-57b3-499b-b6c6-1c4eccfee1b8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.626788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6cdee-57b3-499b-b6c6-1c4eccfee1b8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.628482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6cdee-57b3-499b-b6c6-1c4eccfee1b8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.641174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-09a6cdee-57b3-499b-b6c6-1c4eccfee1b8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 13 16:36:48.643256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 487/975] 10.222.0.62 () {56 vars in 1147 bytes} [Mon Dec 13 16:36:48 2021] GET /identity/v3/services/object-store => generated 93 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:48.649962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35246-4dbd-4834-bc46-dd846746d8b8 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.659311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35246-4dbd-4834-bc46-dd846746d8b8 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.664190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84808628-bd85-445e-8920-b9efe1888d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.664913 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84808628-bd85-445e-8920-b9efe1888d37 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.665199 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84808628-bd85-445e-8920-b9efe1888d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.665466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84808628-bd85-445e-8920-b9efe1888d37 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.666198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84808628-bd85-445e-8920-b9efe1888d37 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:48.666498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84808628-bd85-445e-8920-b9efe1888d37 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.668118 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84808628-bd85-445e-8920-b9efe1888d37 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.673904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 489/976] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Dec 13 16:36:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:48.680669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6cdee-57b3-499b-b6c6-1c4eccfee1b8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.690738 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6cdee-57b3-499b-b6c6-1c4eccfee1b8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.696281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bdd63-c8bc-4cf7-afc1-fe41e7eb92b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.697322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bdd63-c8bc-4cf7-afc1-fe41e7eb92b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.697602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bdd63-c8bc-4cf7-afc1-fe41e7eb92b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.697876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bdd63-c8bc-4cf7-afc1-fe41e7eb92b5 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.698629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bdd63-c8bc-4cf7-afc1-fe41e7eb92b5 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:48.698907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bdd63-c8bc-4cf7-afc1-fe41e7eb92b5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.700496 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bdd63-c8bc-4cf7-afc1-fe41e7eb92b5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.705877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 488/977] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Dec 13 16:36:48 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:48.712721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84808628-bd85-445e-8920-b9efe1888d37 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:48.723012 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84808628-bd85-445e-8920-b9efe1888d37 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:48.728585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df178328-7d44-4c84-ba7d-4232aa910a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:48.729480 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df178328-7d44-4c84-ba7d-4232aa910a01 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:48.730005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df178328-7d44-4c84-ba7d-4232aa910a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:48.730476 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df178328-7d44-4c84-ba7d-4232aa910a01 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:48.731479 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df178328-7d44-4c84-ba7d-4232aa910a01 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:48.733404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df178328-7d44-4c84-ba7d-4232aa910a01 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:48.755346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 490/978] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Dec 13 16:36:48 2021] POST /identity/v3/endpoints => generated 349 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:50.559961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ccd9-5119-4e0b-b572-f5275126a95f None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:50.560492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ccd9-5119-4e0b-b572-f5275126a95f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:50.561032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5ccd9-5119-4e0b-b572-f5275126a95f None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:50.564408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 489/979] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:50 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:50.573348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14299-2ea7-4ce8-bd78-95350abe4504 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:50.573855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14299-2ea7-4ce8-bd78-95350abe4504 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:50.573855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc14299-2ea7-4ce8-bd78-95350abe4504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:50.592216 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-ccc14299-2ea7-4ce8-bd78-95350abe4504 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:50.593429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ccc14299-2ea7-4ce8-bd78-95350abe4504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:50.610209 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 491/980] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:50 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:50.634351 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5ccd9-5119-4e0b-b572-f5275126a95f None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:50.646943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5ccd9-5119-4e0b-b572-f5275126a95f None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:50.651378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fadcb7-ad03-4ef0-b818-9cff6919b5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:50.652043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fadcb7-ad03-4ef0-b818-9cff6919b5de admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:50.652322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fadcb7-ad03-4ef0-b818-9cff6919b5de admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:50.652605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fadcb7-ad03-4ef0-b818-9cff6919b5de admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:50.653366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fadcb7-ad03-4ef0-b818-9cff6919b5de admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:50.654964 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fadcb7-ad03-4ef0-b818-9cff6919b5de admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:50.676197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 490/981] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:36:50 2021] POST /identity/v3/services => generated 242 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:50.755368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8e0b4-d99e-461e-b8b9-f66793dece34 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:50.755719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8e0b4-d99e-461e-b8b9-f66793dece34 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:50.755929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8e0b4-d99e-461e-b8b9-f66793dece34 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:50.758535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 492/982] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:50.765760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e8698-2ab3-46c6-a09a-0dd3686d9fcd None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:50.766408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e8698-2ab3-46c6-a09a-0dd3686d9fcd None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:50.766887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e8698-2ab3-46c6-a09a-0dd3686d9fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:50.786801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-078e8698-2ab3-46c6-a09a-0dd3686d9fcd None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:50.788465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-078e8698-2ab3-46c6-a09a-0dd3686d9fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:50.812714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 491/983] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:50 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:50.831600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8e0b4-d99e-461e-b8b9-f66793dece34 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:50.844882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8e0b4-d99e-461e-b8b9-f66793dece34 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:50.849722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2856cd-fede-4afb-96b7-1b7692890144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:50.850820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2856cd-fede-4afb-96b7-1b7692890144 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:50.851312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2856cd-fede-4afb-96b7-1b7692890144 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:50.851814 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2856cd-fede-4afb-96b7-1b7692890144 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:50.852822 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2856cd-fede-4afb-96b7-1b7692890144 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:50.854755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2856cd-fede-4afb-96b7-1b7692890144 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:50.876749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 493/984] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:36:50 2021] POST /identity/v3/services => generated 242 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:50.974706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c68d1-5929-45d6-98f6-2aa317e7eb32 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:50.975667 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c68d1-5929-45d6-98f6-2aa317e7eb32 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:50.976181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c68d1-5929-45d6-98f6-2aa317e7eb32 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:50.978714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 492/985] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:50.984664 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bafed-674a-4a8f-8de2-7368f5684b36 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:50.984961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bafed-674a-4a8f-8de2-7368f5684b36 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:50.985265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bafed-674a-4a8f-8de2-7368f5684b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:51.004650 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-976bafed-674a-4a8f-8de2-7368f5684b36 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:51.005856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-976bafed-674a-4a8f-8de2-7368f5684b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:51.024734 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 494/986] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:50 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:51.050569 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c68d1-5929-45d6-98f6-2aa317e7eb32 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:51.063914 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c68d1-5929-45d6-98f6-2aa317e7eb32 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:51.068398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75efa26-bf09-443b-9425-aa35e08c0698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:51.069288 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75efa26-bf09-443b-9425-aa35e08c0698 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:51.069620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75efa26-bf09-443b-9425-aa35e08c0698 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:51.069899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75efa26-bf09-443b-9425-aa35e08c0698 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:51.070646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75efa26-bf09-443b-9425-aa35e08c0698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:51.072539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75efa26-bf09-443b-9425-aa35e08c0698 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:51.073909 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.common [None req-a75efa26-bf09-443b-9425-aa35e08c0698 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Dec 13 16:36:51.088767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.sql.core [None req-a75efa26-bf09-443b-9425-aa35e08c0698 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Dec 13 16:36:51.088767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Dec 13 16:36:51.088767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [parameters: {'user_id': 'bf533e27ea1241ae966a74685779910f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Dec 13 16:36:51.088767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86094) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Dec 13 16:36:51.103549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a75efa26-bf09-443b-9425-aa35e08c0698 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Dec 13 16:36:51.105376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 493/987] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:36:51 2021] POST /identity/v3/users => generated 160 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:51.112000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bafed-674a-4a8f-8de2-7368f5684b36 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:51.123674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976bafed-674a-4a8f-8de2-7368f5684b36 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:51.128283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2510593-4f36-4df6-a5a3-f3a616db9928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:51.129119 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2510593-4f36-4df6-a5a3-f3a616db9928 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:51.129403 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2510593-4f36-4df6-a5a3-f3a616db9928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:51.129676 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2510593-4f36-4df6-a5a3-f3a616db9928 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:51.138200 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2510593-4f36-4df6-a5a3-f3a616db9928 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:51.140624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2510593-4f36-4df6-a5a3-f3a616db9928 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:51.154920 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-a2510593-4f36-4df6-a5a3-f3a616db9928 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Dec 13 16:36:51.156443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 495/988] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:36:51 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:51.163312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75efa26-bf09-443b-9425-aa35e08c0698 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:51.166642 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f7d6-758b-4eb9-b225-befbc773d561 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:51.166934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f7d6-758b-4eb9-b225-befbc773d561 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:51.167196 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253f7d6-758b-4eb9-b225-befbc773d561 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:51.169155 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 496/989] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:51.174731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350d3cd-dde1-4b51-a6ec-546a8751d0f3 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:51.175015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350d3cd-dde1-4b51-a6ec-546a8751d0f3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:51.175289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350d3cd-dde1-4b51-a6ec-546a8751d0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:51.177625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75efa26-bf09-443b-9425-aa35e08c0698 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:51.184734 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c3315-390e-4cf7-871f-832318156149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:51.185414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c3315-390e-4cf7-871f-832318156149 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:51.185692 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c3315-390e-4cf7-871f-832318156149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:51.185967 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c3315-390e-4cf7-871f-832318156149 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:51.186791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c3315-390e-4cf7-871f-832318156149 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:51.187095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c3315-390e-4cf7-871f-832318156149 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:51.189798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c3315-390e-4cf7-871f-832318156149 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:51.194113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7350d3cd-dde1-4b51-a6ec-546a8751d0f3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:51.195333 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7350d3cd-dde1-4b51-a6ec-546a8751d0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:51.203841 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 497/990] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:51 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:51.228295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350d3cd-dde1-4b51-a6ec-546a8751d0f3 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:51.232665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 494/991] 10.222.0.62 () {56 vars in 1122 bytes} [Mon Dec 13 16:36:51 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:51.242217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350d3cd-dde1-4b51-a6ec-546a8751d0f3 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:51.247065 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d443b-820d-4ea0-a33c-b8518b68fe4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:51.247958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d443b-820d-4ea0-a33c-b8518b68fe4b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:51.248237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d443b-820d-4ea0-a33c-b8518b68fe4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:51.248511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d443b-820d-4ea0-a33c-b8518b68fe4b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:51.249225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d443b-820d-4ea0-a33c-b8518b68fe4b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:51.251050 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d443b-820d-4ea0-a33c-b8518b68fe4b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:51.263449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-276d443b-820d-4ea0-a33c-b8518b68fe4b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 13 16:36:51.265546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 498/992] 10.222.0.62 () {56 vars in 1147 bytes} [Mon Dec 13 16:36:51 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:51.272739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c3315-390e-4cf7-871f-832318156149 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:51.283243 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c3315-390e-4cf7-871f-832318156149 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:51.288811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ecec3-12e8-4d49-b67f-cffc8e8362ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:51.289567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ecec3-12e8-4d49-b67f-cffc8e8362ca admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:51.289842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ecec3-12e8-4d49-b67f-cffc8e8362ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:51.290158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ecec3-12e8-4d49-b67f-cffc8e8362ca admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:51.290899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ecec3-12e8-4d49-b67f-cffc8e8362ca admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:51.291201 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ecec3-12e8-4d49-b67f-cffc8e8362ca admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:51.292965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ecec3-12e8-4d49-b67f-cffc8e8362ca admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:51.299120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 495/993] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Dec 13 16:36:51 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:51.306304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d443b-820d-4ea0-a33c-b8518b68fe4b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:51.316627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d443b-820d-4ea0-a33c-b8518b68fe4b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:51.325969 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95469d-ccfe-4b6e-8b75-5f954533ec5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:51.326654 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95469d-ccfe-4b6e-8b75-5f954533ec5a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:51.326974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95469d-ccfe-4b6e-8b75-5f954533ec5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:51.327247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95469d-ccfe-4b6e-8b75-5f954533ec5a admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:51.327981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95469d-ccfe-4b6e-8b75-5f954533ec5a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:51.328331 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95469d-ccfe-4b6e-8b75-5f954533ec5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:51.330062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95469d-ccfe-4b6e-8b75-5f954533ec5a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:51.336273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 499/994] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Dec 13 16:36:51 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:51.343066 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ecec3-12e8-4d49-b67f-cffc8e8362ca admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:51.353432 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ecec3-12e8-4d49-b67f-cffc8e8362ca admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:51.358262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e096c94-bbfd-4be7-b03c-d4032651a37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:51.358990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e096c94-bbfd-4be7-b03c-d4032651a37b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:51.359266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e096c94-bbfd-4be7-b03c-d4032651a37b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:51.359540 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e096c94-bbfd-4be7-b03c-d4032651a37b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:51.360399 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e096c94-bbfd-4be7-b03c-d4032651a37b admin admin] RBAC: Adding query filter params (interface=admin, service_id=a7674c9115ee4186ab661a333a21dc1f, region_id=RegionOne) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:51.360737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e096c94-bbfd-4be7-b03c-d4032651a37b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:51.362462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e096c94-bbfd-4be7-b03c-d4032651a37b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:51.369297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 496/995] 10.222.0.62 () {56 vars in 1270 bytes} [Mon Dec 13 16:36:51 2021] GET /identity/v3/endpoints?service_id=a7674c9115ee4186ab661a333a21dc1f&interface=admin®ion_id=RegionOne => generated 193 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:51.375987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95469d-ccfe-4b6e-8b75-5f954533ec5a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:51.386510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95469d-ccfe-4b6e-8b75-5f954533ec5a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:51.391813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec383d-15e4-469d-8fd7-a5cddec63ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:51.392483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec383d-15e4-469d-8fd7-a5cddec63ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:51.392830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec383d-15e4-469d-8fd7-a5cddec63ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:51.393097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec383d-15e4-469d-8fd7-a5cddec63ce2 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:51.393835 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec383d-15e4-469d-8fd7-a5cddec63ce2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:51.395596 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec383d-15e4-469d-8fd7-a5cddec63ce2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:51.403553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 500/996] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Dec 13 16:36:51 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:36:53.113767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b0fde-9ad0-46bf-a0ff-423c70045a9e None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.114353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b0fde-9ad0-46bf-a0ff-423c70045a9e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.114353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b0fde-9ad0-46bf-a0ff-423c70045a9e None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.116065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 497/997] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:53.122057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38b2b-8a29-49c5-ada9-7610dfd33870 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.122469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38b2b-8a29-49c5-ada9-7610dfd33870 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.122568 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38b2b-8a29-49c5-ada9-7610dfd33870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.140931 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9ff38b2b-8a29-49c5-ada9-7610dfd33870 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:53.142084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9ff38b2b-8a29-49c5-ada9-7610dfd33870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:53.150064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 501/998] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:53 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:53.173810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b0fde-9ad0-46bf-a0ff-423c70045a9e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.185950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b0fde-9ad0-46bf-a0ff-423c70045a9e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.190104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212900b-157e-4577-a2f8-ebe927dbf39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.190900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212900b-157e-4577-a2f8-ebe927dbf39d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.191178 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212900b-157e-4577-a2f8-ebe927dbf39d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.191442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212900b-157e-4577-a2f8-ebe927dbf39d admin admin] PATH_INFO: `/v3/services/image` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.192101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212900b-157e-4577-a2f8-ebe927dbf39d admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.194189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212900b-157e-4577-a2f8-ebe927dbf39d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.205536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-9212900b-157e-4577-a2f8-ebe927dbf39d admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 13 16:36:53.206903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 498/999] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:53.213428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff38b2b-8a29-49c5-ada9-7610dfd33870 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.222522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff38b2b-8a29-49c5-ada9-7610dfd33870 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.227852 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb91ca-2b50-45f0-926d-64a6e718cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.228503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb91ca-2b50-45f0-926d-64a6e718cb47 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.228809 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb91ca-2b50-45f0-926d-64a6e718cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.229056 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb91ca-2b50-45f0-926d-64a6e718cb47 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.229780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb91ca-2b50-45f0-926d-64a6e718cb47 admin admin] RBAC: Adding query filter params (name=image) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:53.230075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb91ca-2b50-45f0-926d-64a6e718cb47 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.231660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb91ca-2b50-45f0-926d-64a6e718cb47 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.236862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 502/1000] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:53.242894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212900b-157e-4577-a2f8-ebe927dbf39d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.252929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212900b-157e-4577-a2f8-ebe927dbf39d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.258019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5353ca2-ca8c-413f-885c-b887b2d62272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.258704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5353ca2-ca8c-413f-885c-b887b2d62272 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.259033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5353ca2-ca8c-413f-885c-b887b2d62272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.259304 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5353ca2-ca8c-413f-885c-b887b2d62272 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.260021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5353ca2-ca8c-413f-885c-b887b2d62272 admin admin] RBAC: Adding query filter params (type=image) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:53.260318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5353ca2-ca8c-413f-885c-b887b2d62272 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.261931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5353ca2-ca8c-413f-885c-b887b2d62272 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.272595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 499/1001] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:53.274772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb91ca-2b50-45f0-926d-64a6e718cb47 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.284728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb91ca-2b50-45f0-926d-64a6e718cb47 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.290150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dea658-1cfd-4905-ba6c-18be5a4241db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.290883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dea658-1cfd-4905-ba6c-18be5a4241db admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.291223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dea658-1cfd-4905-ba6c-18be5a4241db admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.291557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dea658-1cfd-4905-ba6c-18be5a4241db admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.292415 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dea658-1cfd-4905-ba6c-18be5a4241db admin admin] RBAC: Adding query filter params (interface=public, service_id=2934fc68cfc64711b856377245c8c281, region_id=RegionOne) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:53.292808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dea658-1cfd-4905-ba6c-18be5a4241db admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.294467 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dea658-1cfd-4905-ba6c-18be5a4241db admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.300092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 503/1002] 10.222.0.62 () {56 vars in 1272 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/endpoints?service_id=2934fc68cfc64711b856377245c8c281&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:53.306220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5353ca2-ca8c-413f-885c-b887b2d62272 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.315791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5353ca2-ca8c-413f-885c-b887b2d62272 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.323822 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8af7f-81f5-4dcc-9126-55eb398aa133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.324493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8af7f-81f5-4dcc-9126-55eb398aa133 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.324796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8af7f-81f5-4dcc-9126-55eb398aa133 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.325064 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f8af7f-81f5-4dcc-9126-55eb398aa133 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.325759 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8af7f-81f5-4dcc-9126-55eb398aa133 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.327353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f8af7f-81f5-4dcc-9126-55eb398aa133 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.330509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33432bd-7443-4c2d-843d-53686be6f65d None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.330800 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33432bd-7443-4c2d-843d-53686be6f65d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.331085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33432bd-7443-4c2d-843d-53686be6f65d None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.333247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 504/1003] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:53.339080 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03c58-db41-434b-89e2-6fa93c488e2e None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.339369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03c58-db41-434b-89e2-6fa93c488e2e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.339648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03c58-db41-434b-89e2-6fa93c488e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.340778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 500/1004] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/services => generated 1957 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:36:53.358543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c8c03c58-db41-434b-89e2-6fa93c488e2e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:53.359753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c8c03c58-db41-434b-89e2-6fa93c488e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:53.367791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 505/1005] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:53 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:53.393108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8af7f-81f5-4dcc-9126-55eb398aa133 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.404220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f8af7f-81f5-4dcc-9126-55eb398aa133 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.409375 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb2faf-fb20-4c55-a141-6fe7fdb94f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.410203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb2faf-fb20-4c55-a141-6fe7fdb94f19 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.410481 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb2faf-fb20-4c55-a141-6fe7fdb94f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.410743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb2faf-fb20-4c55-a141-6fe7fdb94f19 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.411425 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb2faf-fb20-4c55-a141-6fe7fdb94f19 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.413086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb2faf-fb20-4c55-a141-6fe7fdb94f19 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.425159 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-bcfb2faf-fb20-4c55-a141-6fe7fdb94f19 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 13 16:36:53.427482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 501/1006] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:53.433463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c03c58-db41-434b-89e2-6fa93c488e2e None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.442805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c03c58-db41-434b-89e2-6fa93c488e2e None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.447812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433204b8-1197-4fac-bf36-80fe4c459190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.448486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433204b8-1197-4fac-bf36-80fe4c459190 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.448796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433204b8-1197-4fac-bf36-80fe4c459190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.449047 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433204b8-1197-4fac-bf36-80fe4c459190 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.449943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433204b8-1197-4fac-bf36-80fe4c459190 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:53.450242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433204b8-1197-4fac-bf36-80fe4c459190 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.451953 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433204b8-1197-4fac-bf36-80fe4c459190 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.457916 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 506/1007] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:53.464618 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb2faf-fb20-4c55-a141-6fe7fdb94f19 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.477641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb2faf-fb20-4c55-a141-6fe7fdb94f19 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.482799 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1972d97-3891-468e-95de-f7b57377fa6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.483483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1972d97-3891-468e-95de-f7b57377fa6d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.483808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1972d97-3891-468e-95de-f7b57377fa6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.484046 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1972d97-3891-468e-95de-f7b57377fa6d admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.484831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1972d97-3891-468e-95de-f7b57377fa6d admin admin] RBAC: Adding query filter params (type=compute) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:53.485179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1972d97-3891-468e-95de-f7b57377fa6d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.486817 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1972d97-3891-468e-95de-f7b57377fa6d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.493502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 502/1008] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:53.500279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433204b8-1197-4fac-bf36-80fe4c459190 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.510949 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433204b8-1197-4fac-bf36-80fe4c459190 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.516442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ad5e8-50f7-41cb-9585-130d55a84132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.517184 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ad5e8-50f7-41cb-9585-130d55a84132 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.517459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ad5e8-50f7-41cb-9585-130d55a84132 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.517777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ad5e8-50f7-41cb-9585-130d55a84132 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.518577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ad5e8-50f7-41cb-9585-130d55a84132 admin admin] RBAC: Adding query filter params (interface=public, service_id=0f6b1a9277f94c8fb296fab967961638, region_id=RegionOne) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:53.518938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ad5e8-50f7-41cb-9585-130d55a84132 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.520626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ad5e8-50f7-41cb-9585-130d55a84132 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.532266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 507/1009] 10.222.0.62 () {56 vars in 1272 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/endpoints?service_id=0f6b1a9277f94c8fb296fab967961638&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:53.534042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1972d97-3891-468e-95de-f7b57377fa6d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.544682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1972d97-3891-468e-95de-f7b57377fa6d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.549712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd343f0e-0e8a-4b3a-890c-211863868d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.550471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343f0e-0e8a-4b3a-890c-211863868d11 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.550822 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343f0e-0e8a-4b3a-890c-211863868d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.551164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd343f0e-0e8a-4b3a-890c-211863868d11 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.551934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd343f0e-0e8a-4b3a-890c-211863868d11 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.553831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd343f0e-0e8a-4b3a-890c-211863868d11 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.561481 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 503/1010] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:36:53.820237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e63ab9-9034-4e5a-b3b3-dc0c6efcea5d None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.820667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e63ab9-9034-4e5a-b3b3-dc0c6efcea5d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.820860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e63ab9-9034-4e5a-b3b3-dc0c6efcea5d None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.822730 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 508/1011] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:53.828487 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf513e-bad6-49c6-8caa-2f11945ce153 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.828889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf513e-bad6-49c6-8caa-2f11945ce153 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.829231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf513e-bad6-49c6-8caa-2f11945ce153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.847925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-eabf513e-bad6-49c6-8caa-2f11945ce153 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:53.849462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-eabf513e-bad6-49c6-8caa-2f11945ce153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:53.857877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 504/1012] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:53 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:53.881261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e63ab9-9034-4e5a-b3b3-dc0c6efcea5d None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.894250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e63ab9-9034-4e5a-b3b3-dc0c6efcea5d None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.898945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb2479-0a7a-4d68-9789-bdf3ed22f96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.899732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2479-0a7a-4d68-9789-bdf3ed22f96c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.900005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2479-0a7a-4d68-9789-bdf3ed22f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.900266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2479-0a7a-4d68-9789-bdf3ed22f96c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.900947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb2479-0a7a-4d68-9789-bdf3ed22f96c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.902521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb2479-0a7a-4d68-9789-bdf3ed22f96c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.913774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-36bb2479-0a7a-4d68-9789-bdf3ed22f96c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Dec 13 16:36:53.915096 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 509/1013] 10.222.0.62 () {56 vars in 1147 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:53.921547 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf513e-bad6-49c6-8caa-2f11945ce153 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.931120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf513e-bad6-49c6-8caa-2f11945ce153 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.935973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81009784-7396-43f2-9f0f-c975a03759d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.936783 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009784-7396-43f2-9f0f-c975a03759d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.937137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009784-7396-43f2-9f0f-c975a03759d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.937484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81009784-7396-43f2-9f0f-c975a03759d2 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.938225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81009784-7396-43f2-9f0f-c975a03759d2 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:53.938534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81009784-7396-43f2-9f0f-c975a03759d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.940139 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81009784-7396-43f2-9f0f-c975a03759d2 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.948598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 505/1014] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:53.951903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb2479-0a7a-4d68-9789-bdf3ed22f96c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.961674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb2479-0a7a-4d68-9789-bdf3ed22f96c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.966360 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846c0f0-a358-4f9a-9a70-12ffc3cf34bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.967017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846c0f0-a358-4f9a-9a70-12ffc3cf34bb admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.967291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846c0f0-a358-4f9a-9a70-12ffc3cf34bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.967559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846c0f0-a358-4f9a-9a70-12ffc3cf34bb admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.968264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846c0f0-a358-4f9a-9a70-12ffc3cf34bb admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:53.968561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846c0f0-a358-4f9a-9a70-12ffc3cf34bb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:53.970166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846c0f0-a358-4f9a-9a70-12ffc3cf34bb admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:53.975577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 510/1015] 10.222.0.62 () {56 vars in 1143 bytes} [Mon Dec 13 16:36:53 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:53.981590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81009784-7396-43f2-9f0f-c975a03759d2 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:53.992265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81009784-7396-43f2-9f0f-c975a03759d2 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:53.997002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdaa8de-7ed5-4fb5-a13d-8eafbe735eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:53.997653 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaa8de-7ed5-4fb5-a13d-8eafbe735eae admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:53.997933 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaa8de-7ed5-4fb5-a13d-8eafbe735eae admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:53.998202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdaa8de-7ed5-4fb5-a13d-8eafbe735eae admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:53.998959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaa8de-7ed5-4fb5-a13d-8eafbe735eae admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:54.000551 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdaa8de-7ed5-4fb5-a13d-8eafbe735eae admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:54.017519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 506/1016] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Dec 13 16:36:53 2021] POST /identity/v3/endpoints => generated 325 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:55.720752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676b18d-fafe-4dd5-b233-68fd0df96941 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:55.721300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676b18d-fafe-4dd5-b233-68fd0df96941 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:55.721300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2676b18d-fafe-4dd5-b233-68fd0df96941 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:55.723274 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 511/1017] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:55.728874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120271-c43a-4d8e-be58-713ce4c410a2 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:55.729287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120271-c43a-4d8e-be58-713ce4c410a2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:55.729385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a120271-c43a-4d8e-be58-713ce4c410a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:55.747070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7a120271-c43a-4d8e-be58-713ce4c410a2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:55.748252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7a120271-c43a-4d8e-be58-713ce4c410a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:55.765634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 507/1018] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:55 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:55.790425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676b18d-fafe-4dd5-b233-68fd0df96941 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:55.803415 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2676b18d-fafe-4dd5-b233-68fd0df96941 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:55.807886 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418c880-0039-412f-b1c3-1ad1bd536325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:55.808738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c880-0039-412f-b1c3-1ad1bd536325 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:55.809022 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c880-0039-412f-b1c3-1ad1bd536325 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:55.809295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c880-0039-412f-b1c3-1ad1bd536325 admin admin] PATH_INFO: `/v3/services/image` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:55.809961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418c880-0039-412f-b1c3-1ad1bd536325 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:55.811568 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418c880-0039-412f-b1c3-1ad1bd536325 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:55.822762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-f418c880-0039-412f-b1c3-1ad1bd536325 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Dec 13 16:36:55.824948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 512/1019] 10.222.0.62 () {56 vars in 1126 bytes} [Mon Dec 13 16:36:55 2021] GET /identity/v3/services/image => generated 86 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:55.833215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a120271-c43a-4d8e-be58-713ce4c410a2 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:55.842862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a120271-c43a-4d8e-be58-713ce4c410a2 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:55.847645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a2e66-b94c-4900-a042-45a0837662e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:55.848409 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a2e66-b94c-4900-a042-45a0837662e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:55.848787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a2e66-b94c-4900-a042-45a0837662e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:55.849136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a2e66-b94c-4900-a042-45a0837662e3 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:55.850042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a2e66-b94c-4900-a042-45a0837662e3 admin admin] RBAC: Adding query filter params (name=image) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:55.850413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a2e66-b94c-4900-a042-45a0837662e3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:55.852100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a2e66-b94c-4900-a042-45a0837662e3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:55.860630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 508/1020] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:55 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:55.864096 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418c880-0039-412f-b1c3-1ad1bd536325 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:55.874576 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418c880-0039-412f-b1c3-1ad1bd536325 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:55.879271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832f1d6-7ae3-42fd-ab6e-970456272942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:55.879916 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832f1d6-7ae3-42fd-ab6e-970456272942 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:55.880194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832f1d6-7ae3-42fd-ab6e-970456272942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:55.880426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832f1d6-7ae3-42fd-ab6e-970456272942 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:55.881491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832f1d6-7ae3-42fd-ab6e-970456272942 admin admin] RBAC: Adding query filter params (type=image) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:55.881858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832f1d6-7ae3-42fd-ab6e-970456272942 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:55.883457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832f1d6-7ae3-42fd-ab6e-970456272942 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:55.888842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 513/1021] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:55 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:55.895335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a2e66-b94c-4900-a042-45a0837662e3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:55.903569 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f2c4-435e-4b56-9c62-ee766a36b97a None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:55.903801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f2c4-435e-4b56-9c62-ee766a36b97a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:55.904075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967f2c4-435e-4b56-9c62-ee766a36b97a None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:55.906024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 514/1022] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:55.906126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a2e66-b94c-4900-a042-45a0837662e3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:55.910858 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd01f0-bac2-40d7-ac48-40329701fdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:55.911228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02409a-fa9c-48a9-af05-8b0d41d002f1 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:55.911516 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02409a-fa9c-48a9-af05-8b0d41d002f1 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:55.911610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd01f0-bac2-40d7-ac48-40329701fdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:55.911786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02409a-fa9c-48a9-af05-8b0d41d002f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:55.911879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd01f0-bac2-40d7-ac48-40329701fdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:55.912057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd01f0-bac2-40d7-ac48-40329701fdd7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:55.912949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd01f0-bac2-40d7-ac48-40329701fdd7 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:55.914544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd01f0-bac2-40d7-ac48-40329701fdd7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:55.929930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-3f02409a-fa9c-48a9-af05-8b0d41d002f1 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:55.931103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3f02409a-fa9c-48a9-af05-8b0d41d002f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:55.944879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 509/1023] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Dec 13 16:36:55 2021] POST /identity/v3/endpoints => generated 327 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:55.955914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 515/1024] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:55 2021] POST /identity/v3/auth/tokens => generated 2817 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:55.980439 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd01f0-bac2-40d7-ac48-40329701fdd7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:55.991454 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd01f0-bac2-40d7-ac48-40329701fdd7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:55.996367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a872ac9-6de7-4bca-9e94-cb4f286f89b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:55.997273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872ac9-6de7-4bca-9e94-cb4f286f89b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:55.997552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872ac9-6de7-4bca-9e94-cb4f286f89b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:55.997826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a872ac9-6de7-4bca-9e94-cb4f286f89b3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:55.998508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a872ac9-6de7-4bca-9e94-cb4f286f89b3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:56.000162 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a872ac9-6de7-4bca-9e94-cb4f286f89b3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:56.012066 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-6a872ac9-6de7-4bca-9e94-cb4f286f89b3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Dec 13 16:36:56.013384 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 510/1025] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:55 2021] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:56.020616 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02409a-fa9c-48a9-af05-8b0d41d002f1 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:56.029893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02409a-fa9c-48a9-af05-8b0d41d002f1 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:56.034687 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c092f-b77f-4aaf-abb5-6ca0c62b13a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:56.035375 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c092f-b77f-4aaf-abb5-6ca0c62b13a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:56.035658 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c092f-b77f-4aaf-abb5-6ca0c62b13a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:56.035930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c092f-b77f-4aaf-abb5-6ca0c62b13a1 admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:56.036699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c092f-b77f-4aaf-abb5-6ca0c62b13a1 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:56.037006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c092f-b77f-4aaf-abb5-6ca0c62b13a1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:56.038730 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c092f-b77f-4aaf-abb5-6ca0c62b13a1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:56.044340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 516/1026] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:56 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:56.050745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a872ac9-6de7-4bca-9e94-cb4f286f89b3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:56.061793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a872ac9-6de7-4bca-9e94-cb4f286f89b3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:56.066697 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf9569-e5bb-4602-8c9a-bd510a113691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:56.067433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf9569-e5bb-4602-8c9a-bd510a113691 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:56.067719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf9569-e5bb-4602-8c9a-bd510a113691 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:56.068051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf9569-e5bb-4602-8c9a-bd510a113691 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:56.069132 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf9569-e5bb-4602-8c9a-bd510a113691 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:56.069482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf9569-e5bb-4602-8c9a-bd510a113691 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:56.071213 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbf9569-e5bb-4602-8c9a-bd510a113691 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:56.077384 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 511/1027] 10.222.0.62 () {56 vars in 1133 bytes} [Mon Dec 13 16:36:56 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:56.084008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c092f-b77f-4aaf-abb5-6ca0c62b13a1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:56.095151 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c092f-b77f-4aaf-abb5-6ca0c62b13a1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:56.100152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af064a-6cb9-466c-b9b4-34d9c93d2a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:56.100944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af064a-6cb9-466c-b9b4-34d9c93d2a11 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:56.101291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af064a-6cb9-466c-b9b4-34d9c93d2a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:56.101657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af064a-6cb9-466c-b9b4-34d9c93d2a11 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:56.102508 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af064a-6cb9-466c-b9b4-34d9c93d2a11 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:56.104205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af064a-6cb9-466c-b9b4-34d9c93d2a11 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:56.125358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 517/1028] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Dec 13 16:36:56 2021] POST /identity/v3/endpoints => generated 334 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:56.400725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08483c-a926-47ed-94d8-aad0aaa67dbd None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:56.400996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08483c-a926-47ed-94d8-aad0aaa67dbd None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:56.401265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08483c-a926-47ed-94d8-aad0aaa67dbd None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:56.403057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 512/1029] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:56.409335 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246823e1-c631-44d0-b8f2-462c55cbdf1c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:56.409627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246823e1-c631-44d0-b8f2-462c55cbdf1c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:56.409901 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246823e1-c631-44d0-b8f2-462c55cbdf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:56.430107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-246823e1-c631-44d0-b8f2-462c55cbdf1c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:56.431275 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-246823e1-c631-44d0-b8f2-462c55cbdf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:56.452270 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 518/1030] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:56.478697 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08483c-a926-47ed-94d8-aad0aaa67dbd None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:56.493622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08483c-a926-47ed-94d8-aad0aaa67dbd None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:56.498272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5e295-2743-4aa4-a745-18b882515fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:56.499217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e295-2743-4aa4-a745-18b882515fef admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:56.499649 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e295-2743-4aa4-a745-18b882515fef admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:56.500055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5e295-2743-4aa4-a745-18b882515fef admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:56.501407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5e295-2743-4aa4-a745-18b882515fef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:56.503223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5e295-2743-4aa4-a745-18b882515fef admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:56.504991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 513/1031] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:56.512245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246823e1-c631-44d0-b8f2-462c55cbdf1c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:56.521514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246823e1-c631-44d0-b8f2-462c55cbdf1c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:56.526610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32229d12-f4cb-4cf2-b38f-4debe9faae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:56.527272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32229d12-f4cb-4cf2-b38f-4debe9faae42 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:56.527549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32229d12-f4cb-4cf2-b38f-4debe9faae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:56.527819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32229d12-f4cb-4cf2-b38f-4debe9faae42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:56.528548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32229d12-f4cb-4cf2-b38f-4debe9faae42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:56.530473 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32229d12-f4cb-4cf2-b38f-4debe9faae42 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:56.558553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 519/1032] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:36:56 2021] POST /identity/v3/projects => generated 311 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:36:58.344422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29463710-29c1-4443-9a2a-613544416634 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.344986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29463710-29c1-4443-9a2a-613544416634 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.344986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29463710-29c1-4443-9a2a-613544416634 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.347012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 514/1033] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:58.353288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e591771-322c-4e93-bbd2-241d2ae49296 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.353706 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e591771-322c-4e93-bbd2-241d2ae49296 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.353889 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e591771-322c-4e93-bbd2-241d2ae49296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.372232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9e591771-322c-4e93-bbd2-241d2ae49296 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:58.373449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9e591771-322c-4e93-bbd2-241d2ae49296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:58.432388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 520/1034] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:58.455924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29463710-29c1-4443-9a2a-613544416634 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:58.468957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29463710-29c1-4443-9a2a-613544416634 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:58.473922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98918232-086d-4938-8291-8bba9bb56dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:58.474854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98918232-086d-4938-8291-8bba9bb56dea admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.475230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98918232-086d-4938-8291-8bba9bb56dea admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.475583 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98918232-086d-4938-8291-8bba9bb56dea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.486169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98918232-086d-4938-8291-8bba9bb56dea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:58.487976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98918232-086d-4938-8291-8bba9bb56dea admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:58.497429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 515/1035] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:58 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:36:58.504171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e591771-322c-4e93-bbd2-241d2ae49296 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:58.513608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e591771-322c-4e93-bbd2-241d2ae49296 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:58.518922 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76aa024-2f5e-4a4f-9be4-20d031682519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:58.519879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aa024-2f5e-4a4f-9be4-20d031682519 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.520226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aa024-2f5e-4a4f-9be4-20d031682519 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.520563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aa024-2f5e-4a4f-9be4-20d031682519 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.522181 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76aa024-2f5e-4a4f-9be4-20d031682519 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:58.524012 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76aa024-2f5e-4a4f-9be4-20d031682519 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:58.525996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 521/1036] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:58.576930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e7a65-aca5-4c6b-bab2-53a12fc357b0 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.577121 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e7a65-aca5-4c6b-bab2-53a12fc357b0 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.577342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e7a65-aca5-4c6b-bab2-53a12fc357b0 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.579350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 516/1037] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:36:58.585700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a514-7732-4c89-9b92-0a5678b05c04 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.586056 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a514-7732-4c89-9b92-0a5678b05c04 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.586241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a514-7732-4c89-9b92-0a5678b05c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.605611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-91c1a514-7732-4c89-9b92-0a5678b05c04 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:58.606822 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-91c1a514-7732-4c89-9b92-0a5678b05c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:58.616623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 522/1038] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:36:58.640780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e7a65-aca5-4c6b-bab2-53a12fc357b0 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:58.654725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e7a65-aca5-4c6b-bab2-53a12fc357b0 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:58.659465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d9f9a-2b3c-4016-aa13-178e39fc8c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:58.660303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d9f9a-2b3c-4016-aa13-178e39fc8c0d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.660599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d9f9a-2b3c-4016-aa13-178e39fc8c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.660891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d9f9a-2b3c-4016-aa13-178e39fc8c0d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.676101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d9f9a-2b3c-4016-aa13-178e39fc8c0d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:36:58.684169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-544d9f9a-2b3c-4016-aa13-178e39fc8c0d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 13 16:36:58.685699 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 517/1039] 10.222.0.62 () {56 vars in 1141 bytes} [Mon Dec 13 16:36:58 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:58.692328 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1a514-7732-4c89-9b92-0a5678b05c04 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:58.702586 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1a514-7732-4c89-9b92-0a5678b05c04 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:58.707594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4bc77-fc02-4481-bea1-2f392e623faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:58.708422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4bc77-fc02-4481-bea1-2f392e623faa admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.708793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4bc77-fc02-4481-bea1-2f392e623faa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.709307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4bc77-fc02-4481-bea1-2f392e623faa admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.710161 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4bc77-fc02-4481-bea1-2f392e623faa admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:58.710531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4bc77-fc02-4481-bea1-2f392e623faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:58.712228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4bc77-fc02-4481-bea1-2f392e623faa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:58.722218 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 523/1040] 10.222.0.62 () {56 vars in 1136 bytes} [Mon Dec 13 16:36:58 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:58.728942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d9f9a-2b3c-4016-aa13-178e39fc8c0d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:58.739352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d9f9a-2b3c-4016-aa13-178e39fc8c0d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:58.744790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109ba71-b574-447c-9986-ac7dc282602e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:58.745601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109ba71-b574-447c-9986-ac7dc282602e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.745879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109ba71-b574-447c-9986-ac7dc282602e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.746144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2109ba71-b574-447c-9986-ac7dc282602e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.758085 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109ba71-b574-447c-9986-ac7dc282602e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:58.760048 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2109ba71-b574-447c-9986-ac7dc282602e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:58.777648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-2109ba71-b574-447c-9986-ac7dc282602e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:58.779030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 518/1041] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:58.785302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4bc77-fc02-4481-bea1-2f392e623faa admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:58.795950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4bc77-fc02-4481-bea1-2f392e623faa admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:58.800759 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab609bac-9fdf-4af7-bb5d-c1b5cc95edc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:58.801573 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab609bac-9fdf-4af7-bb5d-c1b5cc95edc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.801991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab609bac-9fdf-4af7-bb5d-c1b5cc95edc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.802445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab609bac-9fdf-4af7-bb5d-c1b5cc95edc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.803458 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab609bac-9fdf-4af7-bb5d-c1b5cc95edc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:58.803900 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab609bac-9fdf-4af7-bb5d-c1b5cc95edc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:58.805517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab609bac-9fdf-4af7-bb5d-c1b5cc95edc2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:58.818266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 524/1042] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:58.825092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109ba71-b574-447c-9986-ac7dc282602e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:58.835180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2109ba71-b574-447c-9986-ac7dc282602e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:58.839653 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54ed87-925d-4a8c-95d2-30f28f359bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:58.840521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54ed87-925d-4a8c-95d2-30f28f359bbe admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.840874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54ed87-925d-4a8c-95d2-30f28f359bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.841148 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54ed87-925d-4a8c-95d2-30f28f359bbe admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.849712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54ed87-925d-4a8c-95d2-30f28f359bbe admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:58.853631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54ed87-925d-4a8c-95d2-30f28f359bbe admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:58.866392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-9a54ed87-925d-4a8c-95d2-30f28f359bbe admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 13 16:36:58.867608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 519/1043] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Dec 13 16:36:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:58.873947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab609bac-9fdf-4af7-bb5d-c1b5cc95edc2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:58.884666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab609bac-9fdf-4af7-bb5d-c1b5cc95edc2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:58.889626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c475d19c-a982-46a1-8b9c-75c0add4ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:58.890290 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475d19c-a982-46a1-8b9c-75c0add4ef0f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.890564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475d19c-a982-46a1-8b9c-75c0add4ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.890831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c475d19c-a982-46a1-8b9c-75c0add4ef0f admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.891672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475d19c-a982-46a1-8b9c-75c0add4ef0f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:58.891974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475d19c-a982-46a1-8b9c-75c0add4ef0f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:58.893834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c475d19c-a982-46a1-8b9c-75c0add4ef0f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:58.912738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 525/1044] 10.222.0.62 () {56 vars in 1154 bytes} [Mon Dec 13 16:36:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:58.919391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54ed87-925d-4a8c-95d2-30f28f359bbe admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:58.929081 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54ed87-925d-4a8c-95d2-30f28f359bbe admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:58.934060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550bb3f-f9cb-4d07-a91b-45ccbe24d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:58.934695 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550bb3f-f9cb-4d07-a91b-45ccbe24d0db admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.934980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550bb3f-f9cb-4d07-a91b-45ccbe24d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.935251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550bb3f-f9cb-4d07-a91b-45ccbe24d0db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.943080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550bb3f-f9cb-4d07-a91b-45ccbe24d0db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:58.945094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550bb3f-f9cb-4d07-a91b-45ccbe24d0db admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:58.945255 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbb9a5-ecd9-4b2e-8b56-d9e9137a060d None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.945661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbb9a5-ecd9-4b2e-8b56-d9e9137a060d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.945997 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbb9a5-ecd9-4b2e-8b56-d9e9137a060d None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.947871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 526/1045] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:36:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:36:58.953862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788b7a1-a9f3-4a83-b35c-8c34bf43cfc7 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.954140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788b7a1-a9f3-4a83-b35c-8c34bf43cfc7 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.954428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788b7a1-a9f3-4a83-b35c-8c34bf43cfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.955576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 520/1046] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:36:58 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:36:58.960789 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550bb3f-f9cb-4d07-a91b-45ccbe24d0db admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:58.970126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550bb3f-f9cb-4d07-a91b-45ccbe24d0db admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:58.972281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b788b7a1-a9f3-4a83-b35c-8c34bf43cfc7 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:36:58.973511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b788b7a1-a9f3-4a83-b35c-8c34bf43cfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:36:58.975313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388455a3-a7db-49e4-9789-fe9599b79b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:58.976000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388455a3-a7db-49e4-9789-fe9599b79b37 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:58.976279 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388455a3-a7db-49e4-9789-fe9599b79b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:58.976557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388455a3-a7db-49e4-9789-fe9599b79b37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:58.981115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 527/1047] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:36:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:36:58.987772 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388455a3-a7db-49e4-9789-fe9599b79b37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:58.989646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388455a3-a7db-49e4-9789-fe9599b79b37 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:59.006457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788b7a1-a9f3-4a83-b35c-8c34bf43cfc7 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:59.007267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-388455a3-a7db-49e4-9789-fe9599b79b37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:36:59.008605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 521/1048] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:36:59.014754 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388455a3-a7db-49e4-9789-fe9599b79b37 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:59.015347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788b7a1-a9f3-4a83-b35c-8c34bf43cfc7 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:59.020139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc330-386c-4612-8486-368302b1ad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:59.020986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc330-386c-4612-8486-368302b1ad50 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:59.021281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc330-386c-4612-8486-368302b1ad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:59.021565 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bc330-386c-4612-8486-368302b1ad50 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:59.022982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bc330-386c-4612-8486-368302b1ad50 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:59.024090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388455a3-a7db-49e4-9789-fe9599b79b37 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:59.024670 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610bc330-386c-4612-8486-368302b1ad50 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:59.026227 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 528/1049] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:36:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:59.028892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2db3b-9e1a-40a8-8c79-9c0bfa7a53f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:59.029537 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2db3b-9e1a-40a8-8c79-9c0bfa7a53f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:59.029816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2db3b-9e1a-40a8-8c79-9c0bfa7a53f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:59.030082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2db3b-9e1a-40a8-8c79-9c0bfa7a53f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:59.030808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2db3b-9e1a-40a8-8c79-9c0bfa7a53f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:59.031171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2db3b-9e1a-40a8-8c79-9c0bfa7a53f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:59.032077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc330-386c-4612-8486-368302b1ad50 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:59.032784 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2db3b-9e1a-40a8-8c79-9c0bfa7a53f0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:59.041222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bc330-386c-4612-8486-368302b1ad50 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:59.045762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 522/1050] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:36:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:36:59.045896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d71f8-b45f-4e5b-be8d-189878760f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:59.046300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d71f8-b45f-4e5b-be8d-189878760f8a admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:59.046577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d71f8-b45f-4e5b-be8d-189878760f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:59.046848 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d71f8-b45f-4e5b-be8d-189878760f8a admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:59.047538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d71f8-b45f-4e5b-be8d-189878760f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:59.049401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d71f8-b45f-4e5b-be8d-189878760f8a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:59.051654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2db3b-9e1a-40a8-8c79-9c0bfa7a53f0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:59.062069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2db3b-9e1a-40a8-8c79-9c0bfa7a53f0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:59.067723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7336463-d406-467f-8cab-3169c23c4d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:59.068785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7336463-d406-467f-8cab-3169c23c4d0e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:59.069455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7336463-d406-467f-8cab-3169c23c4d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:59.069732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7336463-d406-467f-8cab-3169c23c4d0e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:59.071673 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 529/1051] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:36:59 2021] POST /identity/v3/users => generated 285 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:36:59.077011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7336463-d406-467f-8cab-3169c23c4d0e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:59.078991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7336463-d406-467f-8cab-3169c23c4d0e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:59.093487 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a7336463-d406-467f-8cab-3169c23c4d0e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:36:59.094669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 523/1052] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:36:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:36:59.101723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d71f8-b45f-4e5b-be8d-189878760f8a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:59.112164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d71f8-b45f-4e5b-be8d-189878760f8a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:59.117704 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d9cce-36b9-4467-8098-dc1648211ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:59.118389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d9cce-36b9-4467-8098-dc1648211ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:59.118664 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d9cce-36b9-4467-8098-dc1648211ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:59.118929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d9cce-36b9-4467-8098-dc1648211ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:59.119715 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d9cce-36b9-4467-8098-dc1648211ef6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:59.120011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d9cce-36b9-4467-8098-dc1648211ef6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:59.121896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d9cce-36b9-4467-8098-dc1648211ef6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:59.135536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 530/1053] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:36:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:36:59.142929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7336463-d406-467f-8cab-3169c23c4d0e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:36:59.154020 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7336463-d406-467f-8cab-3169c23c4d0e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:36:59.159092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531d63be-c030-4358-9b95-b0209127cf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:36:59.159762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d63be-c030-4358-9b95-b0209127cf55 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:36:59.160034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d63be-c030-4358-9b95-b0209127cf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:36:59.160303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531d63be-c030-4358-9b95-b0209127cf55 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:36:59.161173 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d63be-c030-4358-9b95-b0209127cf55 admin admin] RBAC: Adding query filter params (role.id=3e6310c0228e4643a7cd784cdf3aca43, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=dfecc747eb8d431a8d57f4534d259de8) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:36:59.161480 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d63be-c030-4358-9b95-b0209127cf55 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:36:59.163554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531d63be-c030-4358-9b95-b0209127cf55 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:36:59.170282 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 524/1054] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:36:59 2021] GET /identity/v3/role_assignments?user.id=dfecc747eb8d431a8d57f4534d259de8&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=3e6310c0228e4643a7cd784cdf3aca43 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:01.490408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f89859-30a8-4327-a9d8-853a7d48c2e2 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.490962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f89859-30a8-4327-a9d8-853a7d48c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.490962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f89859-30a8-4327-a9d8-853a7d48c2e2 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.492711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 531/1055] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:01.497661 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ce3c4-a1af-4e80-b702-bb5cda03581e None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.498112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ce3c4-a1af-4e80-b702-bb5cda03581e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.498204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b14fa-8e68-4c60-a127-d888801f55d2 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.498293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ce3c4-a1af-4e80-b702-bb5cda03581e None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.498364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b14fa-8e68-4c60-a127-d888801f55d2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.498497 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b14fa-8e68-4c60-a127-d888801f55d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.500087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 525/1056] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:01.505434 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f33a0-82f1-4154-88cb-6ae348a864cb None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.505711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f33a0-82f1-4154-88cb-6ae348a864cb None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.506069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f33a0-82f1-4154-88cb-6ae348a864cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.516593 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-d56b14fa-8e68-4c60-a127-d888801f55d2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:01.517778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d56b14fa-8e68-4c60-a127-d888801f55d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:01.523995 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-389f33a0-82f1-4154-88cb-6ae348a864cb None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:01.525181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-389f33a0-82f1-4154-88cb-6ae348a864cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:01.525869 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 532/1057] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:37:01.532940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 526/1058] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:37:01.549237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b14fa-8e68-4c60-a127-d888801f55d2 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.556899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f33a0-82f1-4154-88cb-6ae348a864cb None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.558681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b14fa-8e68-4c60-a127-d888801f55d2 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.563468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06ba47-a3b9-4de6-a189-953fd3528c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.564266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06ba47-a3b9-4de6-a189-953fd3528c0b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.564539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06ba47-a3b9-4de6-a189-953fd3528c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.564833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f06ba47-a3b9-4de6-a189-953fd3528c0b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.565938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f33a0-82f1-4154-88cb-6ae348a864cb None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.572131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623534d4-22f0-40cf-bf2b-24614014365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.572890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623534d4-22f0-40cf-bf2b-24614014365d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.573167 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623534d4-22f0-40cf-bf2b-24614014365d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.573437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623534d4-22f0-40cf-bf2b-24614014365d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.574988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f06ba47-a3b9-4de6-a189-953fd3528c0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:37:01.582137 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-9f06ba47-a3b9-4de6-a189-953fd3528c0b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 13 16:37:01.583391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 533/1059] 10.222.0.62 () {56 vars in 1141 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:01.584226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623534d4-22f0-40cf-bf2b-24614014365d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:37:01.589639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06ba47-a3b9-4de6-a189-953fd3528c0b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.591076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-623534d4-22f0-40cf-bf2b-24614014365d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:37:01.592593 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 527/1060] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:01.598449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623534d4-22f0-40cf-bf2b-24614014365d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.604785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f06ba47-a3b9-4de6-a189-953fd3528c0b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.608340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623534d4-22f0-40cf-bf2b-24614014365d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.609727 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcf7d5-eac4-406e-af84-ebdd49baf2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.610325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcf7d5-eac4-406e-af84-ebdd49baf2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.610607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcf7d5-eac4-406e-af84-ebdd49baf2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.610885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dcf7d5-eac4-406e-af84-ebdd49baf2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.611643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcf7d5-eac4-406e-af84-ebdd49baf2d0 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:01.611944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcf7d5-eac4-406e-af84-ebdd49baf2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.612902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39da25-95c0-4d3e-b627-e14ec782a787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.613521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39da25-95c0-4d3e-b627-e14ec782a787 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.613614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dcf7d5-eac4-406e-af84-ebdd49baf2d0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.613792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39da25-95c0-4d3e-b627-e14ec782a787 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.614054 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39da25-95c0-4d3e-b627-e14ec782a787 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.614792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39da25-95c0-4d3e-b627-e14ec782a787 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:01.615107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39da25-95c0-4d3e-b627-e14ec782a787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.617039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af39da25-95c0-4d3e-b627-e14ec782a787 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.622084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 534/1061] 10.222.0.62 () {56 vars in 1136 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:01.628333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 528/1062] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:01.628470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcf7d5-eac4-406e-af84-ebdd49baf2d0 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.634518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39da25-95c0-4d3e-b627-e14ec782a787 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.639986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dcf7d5-eac4-406e-af84-ebdd49baf2d0 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.647825 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39da25-95c0-4d3e-b627-e14ec782a787 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.648414 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4c73-8faa-4457-b56e-e4a80bca18e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.649232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4c73-8faa-4457-b56e-e4a80bca18e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.649510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4c73-8faa-4457-b56e-e4a80bca18e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.649779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd4c73-8faa-4457-b56e-e4a80bca18e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.652555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b45cd-40d2-475a-b481-6813c6537a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.653423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b45cd-40d2-475a-b481-6813c6537a21 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.653700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b45cd-40d2-475a-b481-6813c6537a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.653973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b45cd-40d2-475a-b481-6813c6537a21 admin admin] PATH_INFO: `/v3/users/63fc4713416b411d93d191207efb5d18` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.660988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4c73-8faa-4457-b56e-e4a80bca18e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.663313 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd4c73-8faa-4457-b56e-e4a80bca18e8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.667165 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b45cd-40d2-475a-b481-6813c6537a21 admin admin] RBAC: Authorizing `identity:get_user(user_id=63fc4713416b411d93d191207efb5d18)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.669305 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244b45cd-40d2-475a-b481-6813c6537a21 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.670957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 529/1063] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/users/63fc4713416b411d93d191207efb5d18 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:01.677051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b45cd-40d2-475a-b481-6813c6537a21 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.680795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-a7dd4c73-8faa-4457-b56e-e4a80bca18e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:37:01.682090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 535/1064] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:37:01.687034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b45cd-40d2-475a-b481-6813c6537a21 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.688407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4c73-8faa-4457-b56e-e4a80bca18e8 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.692703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a68dd-5d4f-477f-b5a3-65bbfcf3c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.693428 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a68dd-5d4f-477f-b5a3-65bbfcf3c8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.693703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a68dd-5d4f-477f-b5a3-65bbfcf3c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.693976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a68dd-5d4f-477f-b5a3-65bbfcf3c8e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.698273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd4c73-8faa-4457-b56e-e4a80bca18e8 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.702109 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a68dd-5d4f-477f-b5a3-65bbfcf3c8e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.703212 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b4f65-5351-4716-b7b7-b9bc6025cd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.703827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a68dd-5d4f-477f-b5a3-65bbfcf3c8e6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.703932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b4f65-5351-4716-b7b7-b9bc6025cd49 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.704104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b4f65-5351-4716-b7b7-b9bc6025cd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.704376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b4f65-5351-4716-b7b7-b9bc6025cd49 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.705145 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b4f65-5351-4716-b7b7-b9bc6025cd49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:01.705448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b4f65-5351-4716-b7b7-b9bc6025cd49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.707014 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b4f65-5351-4716-b7b7-b9bc6025cd49 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.712506 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 530/1065] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:37:01.718623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 536/1066] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:01.718744 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a68dd-5d4f-477f-b5a3-65bbfcf3c8e6 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.724339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b4f65-5351-4716-b7b7-b9bc6025cd49 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.727521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a68dd-5d4f-477f-b5a3-65bbfcf3c8e6 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.732390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e44b9-0826-40be-9133-7953f59cf3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.733238 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e44b9-0826-40be-9133-7953f59cf3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.733512 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e44b9-0826-40be-9133-7953f59cf3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.733755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b4f65-5351-4716-b7b7-b9bc6025cd49 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.733888 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e44b9-0826-40be-9133-7953f59cf3d0 admin admin] PATH_INFO: `/v3/projects/be87afc72018494fbd34d8cdd540d614` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.734972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e44b9-0826-40be-9133-7953f59cf3d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=be87afc72018494fbd34d8cdd540d614)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.737014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e44b9-0826-40be-9133-7953f59cf3d0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.738561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de84d6-188e-42d3-ad37-aa28125f94e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.738708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 531/1067] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/projects/be87afc72018494fbd34d8cdd540d614 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:01.739309 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de84d6-188e-42d3-ad37-aa28125f94e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.739588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de84d6-188e-42d3-ad37-aa28125f94e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.739849 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de84d6-188e-42d3-ad37-aa28125f94e9 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.744950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e44b9-0826-40be-9133-7953f59cf3d0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.748325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de84d6-188e-42d3-ad37-aa28125f94e9 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.750337 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de84d6-188e-42d3-ad37-aa28125f94e9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.754030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e44b9-0826-40be-9133-7953f59cf3d0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.758726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d559d4c-87b5-4312-9702-c71aab3e8a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.759329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d559d4c-87b5-4312-9702-c71aab3e8a14 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.759604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d559d4c-87b5-4312-9702-c71aab3e8a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.759877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d559d4c-87b5-4312-9702-c71aab3e8a14 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.760727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d559d4c-87b5-4312-9702-c71aab3e8a14 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=be87afc72018494fbd34d8cdd540d614, user.id=63fc4713416b411d93d191207efb5d18) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:01.761031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d559d4c-87b5-4312-9702-c71aab3e8a14 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.762795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d559d4c-87b5-4312-9702-c71aab3e8a14 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.763312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-f0de84d6-188e-42d3-ad37-aa28125f94e9 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 13 16:37:01.764960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 537/1068] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:37:01.768516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 532/1069] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/role_assignments?user.id=63fc4713416b411d93d191207efb5d18&scope.project.id=be87afc72018494fbd34d8cdd540d614&role.id=f3311ba27a464113b884aa5a1144945d => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:01.770844 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de84d6-188e-42d3-ad37-aa28125f94e9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.781249 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de84d6-188e-42d3-ad37-aa28125f94e9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.786094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27548f7-5c19-4f37-b670-6e488b1dbdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.786788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27548f7-5c19-4f37-b670-6e488b1dbdfa admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.787160 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27548f7-5c19-4f37-b670-6e488b1dbdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.787585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27548f7-5c19-4f37-b670-6e488b1dbdfa admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.788522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27548f7-5c19-4f37-b670-6e488b1dbdfa admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:01.788865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27548f7-5c19-4f37-b670-6e488b1dbdfa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.790891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27548f7-5c19-4f37-b670-6e488b1dbdfa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.811174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 538/1070] 10.222.0.62 () {56 vars in 1154 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:01.817684 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d559d4c-87b5-4312-9702-c71aab3e8a14 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.828597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d559d4c-87b5-4312-9702-c71aab3e8a14 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.834633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abef46-2ffc-4c88-a3fe-358bf6813403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.835645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abef46-2ffc-4c88-a3fe-358bf6813403 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.835921 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abef46-2ffc-4c88-a3fe-358bf6813403 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.836183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abef46-2ffc-4c88-a3fe-358bf6813403 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.848379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abef46-2ffc-4c88-a3fe-358bf6813403 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.850435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32abef46-2ffc-4c88-a3fe-358bf6813403 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.869936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-32abef46-2ffc-4c88-a3fe-358bf6813403 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:37:01.871192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 533/1071] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:01.877832 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27548f7-5c19-4f37-b670-6e488b1dbdfa admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.889553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27548f7-5c19-4f37-b670-6e488b1dbdfa admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.895238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754367a-67d5-4958-8243-7f9eaa78a182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.895944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754367a-67d5-4958-8243-7f9eaa78a182 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.896211 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754367a-67d5-4958-8243-7f9eaa78a182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.896529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754367a-67d5-4958-8243-7f9eaa78a182 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.897352 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754367a-67d5-4958-8243-7f9eaa78a182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:01.897662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754367a-67d5-4958-8243-7f9eaa78a182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.899321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754367a-67d5-4958-8243-7f9eaa78a182 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.912022 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 539/1072] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:01.919016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abef46-2ffc-4c88-a3fe-358bf6813403 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.930640 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abef46-2ffc-4c88-a3fe-358bf6813403 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.936717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04f827-3149-4c64-9f65-f3d4f2d7de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.937538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04f827-3149-4c64-9f65-f3d4f2d7de92 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.937816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04f827-3149-4c64-9f65-f3d4f2d7de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.938084 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04f827-3149-4c64-9f65-f3d4f2d7de92 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.947204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04f827-3149-4c64-9f65-f3d4f2d7de92 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.949234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04f827-3149-4c64-9f65-f3d4f2d7de92 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:01.964453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-3f04f827-3149-4c64-9f65-f3d4f2d7de92 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:37:01.965744 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 534/1073] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:01.972409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754367a-67d5-4958-8243-7f9eaa78a182 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:01.983517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754367a-67d5-4958-8243-7f9eaa78a182 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:01.989316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c9d46-e32a-4389-b97c-46dfed59cdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:01.989969 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9d46-e32a-4389-b97c-46dfed59cdee admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:01.990372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9d46-e32a-4389-b97c-46dfed59cdee admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:01.990661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9d46-e32a-4389-b97c-46dfed59cdee admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:01.991465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c9d46-e32a-4389-b97c-46dfed59cdee admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:01.991769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c9d46-e32a-4389-b97c-46dfed59cdee admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:01.993770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c9d46-e32a-4389-b97c-46dfed59cdee admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:02.007753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 540/1074] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:37:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:02.016897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04f827-3149-4c64-9f65-f3d4f2d7de92 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:02.027924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04f827-3149-4c64-9f65-f3d4f2d7de92 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:02.037287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4a955-2fb1-4b71-8544-358d99ab0548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:02.038387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a955-2fb1-4b71-8544-358d99ab0548 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:02.038668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a955-2fb1-4b71-8544-358d99ab0548 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:02.038941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4a955-2fb1-4b71-8544-358d99ab0548 admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/dfecc747eb8d431a8d57f4534d259de8/roles/3e6310c0228e4643a7cd784cdf3aca43` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:02.041696 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a955-2fb1-4b71-8544-358d99ab0548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=dfecc747eb8d431a8d57f4534d259de8, role_id=3e6310c0228e4643a7cd784cdf3aca43)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:02.044393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4a955-2fb1-4b71-8544-358d99ab0548 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:02.059631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 535/1075] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:37:02 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/dfecc747eb8d431a8d57f4534d259de8/roles/3e6310c0228e4643a7cd784cdf3aca43 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:37:04.173389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d798af4-7a46-4e9b-bac9-24de01853a8a None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.173981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d798af4-7a46-4e9b-bac9-24de01853a8a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.173981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d798af4-7a46-4e9b-bac9-24de01853a8a None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.175705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 541/1076] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:04.182120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c3066-9830-4e0c-a29b-4ee8b6d999a8 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.182605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c3066-9830-4e0c-a29b-4ee8b6d999a8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.182694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c3066-9830-4e0c-a29b-4ee8b6d999a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.201484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-5d8c3066-9830-4e0c-a29b-4ee8b6d999a8 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:04.202664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-5d8c3066-9830-4e0c-a29b-4ee8b6d999a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:04.262764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 536/1077] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:04 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:04.287626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d798af4-7a46-4e9b-bac9-24de01853a8a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.301580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d798af4-7a46-4e9b-bac9-24de01853a8a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.307089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc9359-b949-493e-aa2c-ba71b0f18fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.307880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc9359-b949-493e-aa2c-ba71b0f18fdc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.308163 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc9359-b949-493e-aa2c-ba71b0f18fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.308434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc9359-b949-493e-aa2c-ba71b0f18fdc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.319380 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc9359-b949-493e-aa2c-ba71b0f18fdc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:37:04.326250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-a9cc9359-b949-493e-aa2c-ba71b0f18fdc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:37:04.327440 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 542/1078] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:04.334489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c3066-9830-4e0c-a29b-4ee8b6d999a8 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.343602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c3066-9830-4e0c-a29b-4ee8b6d999a8 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.348559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1bc99-6a8f-4ceb-99e7-a1362025b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.349252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1bc99-6a8f-4ceb-99e7-a1362025b2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.349718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1bc99-6a8f-4ceb-99e7-a1362025b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.350000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1bc99-6a8f-4ceb-99e7-a1362025b2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.350853 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1bc99-6a8f-4ceb-99e7-a1362025b2c4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:04.351158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1bc99-6a8f-4ceb-99e7-a1362025b2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.352809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1bc99-6a8f-4ceb-99e7-a1362025b2c4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.361292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 537/1079] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:04.368059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc9359-b949-493e-aa2c-ba71b0f18fdc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.378409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc9359-b949-493e-aa2c-ba71b0f18fdc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.383617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592492-942e-4f26-869c-751f019d4f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.384466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592492-942e-4f26-869c-751f019d4f7e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.384774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592492-942e-4f26-869c-751f019d4f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.385048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89592492-942e-4f26-869c-751f019d4f7e admin admin] PATH_INFO: `/v3/users/63fc4713416b411d93d191207efb5d18` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.386357 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89592492-942e-4f26-869c-751f019d4f7e admin admin] RBAC: Authorizing `identity:get_user(user_id=63fc4713416b411d93d191207efb5d18)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.387118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61cef5-d685-4f85-8431-d8f2329cc4bb None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.387404 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61cef5-d685-4f85-8431-d8f2329cc4bb None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.387674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61cef5-d685-4f85-8431-d8f2329cc4bb None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.388463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89592492-942e-4f26-869c-751f019d4f7e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.389767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 538/1080] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:04.390387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 543/1081] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/users/63fc4713416b411d93d191207efb5d18 => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:04.395286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df95-0a26-40e6-a107-dc6405d37b65 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.395641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df95-0a26-40e6-a107-dc6405d37b65 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.395923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df95-0a26-40e6-a107-dc6405d37b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.396777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592492-942e-4f26-869c-751f019d4f7e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.406865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89592492-942e-4f26-869c-751f019d4f7e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.411793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e33e1e-5446-47ce-bb80-2823734ffadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.412739 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33e1e-5446-47ce-bb80-2823734ffadd admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.413018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33e1e-5446-47ce-bb80-2823734ffadd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.413290 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e33e1e-5446-47ce-bb80-2823734ffadd admin admin] PATH_INFO: `/v3/projects/be87afc72018494fbd34d8cdd540d614` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.414453 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e33e1e-5446-47ce-bb80-2823734ffadd admin admin] RBAC: Authorizing `identity:get_project(project_id=be87afc72018494fbd34d8cdd540d614)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.415399 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7e63df95-0a26-40e6-a107-dc6405d37b65 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:04.416465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e33e1e-5446-47ce-bb80-2823734ffadd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.416596 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7e63df95-0a26-40e6-a107-dc6405d37b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:04.418126 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 544/1082] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/projects/be87afc72018494fbd34d8cdd540d614 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:04.424590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e33e1e-5446-47ce-bb80-2823734ffadd admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.425017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 539/1083] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:04 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:04.433976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e33e1e-5446-47ce-bb80-2823734ffadd admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.438825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25c214-11b4-4d5a-9a8b-1d8b805a8552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.439648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c214-11b4-4d5a-9a8b-1d8b805a8552 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.439923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c214-11b4-4d5a-9a8b-1d8b805a8552 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.440179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25c214-11b4-4d5a-9a8b-1d8b805a8552 admin admin] PATH_INFO: `/v3/projects/be87afc72018494fbd34d8cdd540d614/users/63fc4713416b411d93d191207efb5d18/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.442165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25c214-11b4-4d5a-9a8b-1d8b805a8552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be87afc72018494fbd34d8cdd540d614, user_id=63fc4713416b411d93d191207efb5d18, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.444850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25c214-11b4-4d5a-9a8b-1d8b805a8552 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.450099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63df95-0a26-40e6-a107-dc6405d37b65 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.459091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63df95-0a26-40e6-a107-dc6405d37b65 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.459904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 545/1084] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:37:04 2021] PUT /identity/v3/projects/be87afc72018494fbd34d8cdd540d614/users/63fc4713416b411d93d191207efb5d18/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:37:04.518410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28170a00-d439-49cb-8f77-555526cc9a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.519252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28170a00-d439-49cb-8f77-555526cc9a60 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.519527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28170a00-d439-49cb-8f77-555526cc9a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.519798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28170a00-d439-49cb-8f77-555526cc9a60 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.532546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28170a00-d439-49cb-8f77-555526cc9a60 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:37:04.540093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-28170a00-d439-49cb-8f77-555526cc9a60 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Dec 13 16:37:04.541416 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 540/1085] 10.222.0.62 () {56 vars in 1141 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:04.548428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25c214-11b4-4d5a-9a8b-1d8b805a8552 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.559858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25c214-11b4-4d5a-9a8b-1d8b805a8552 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.565025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f020-bd17-4df0-8cbb-83f1e4af8709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.565708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f020-bd17-4df0-8cbb-83f1e4af8709 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.565986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f020-bd17-4df0-8cbb-83f1e4af8709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.566257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8f020-bd17-4df0-8cbb-83f1e4af8709 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.567051 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f020-bd17-4df0-8cbb-83f1e4af8709 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:04.567349 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f020-bd17-4df0-8cbb-83f1e4af8709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.569044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8f020-bd17-4df0-8cbb-83f1e4af8709 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.578240 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 546/1086] 10.222.0.62 () {56 vars in 1136 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:04.585120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28170a00-d439-49cb-8f77-555526cc9a60 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.596113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28170a00-d439-49cb-8f77-555526cc9a60 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.602411 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8303aea-ccb2-4627-b028-75d406e1529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.603225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8303aea-ccb2-4627-b028-75d406e1529d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.603501 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8303aea-ccb2-4627-b028-75d406e1529d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.603748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8303aea-ccb2-4627-b028-75d406e1529d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.616877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8303aea-ccb2-4627-b028-75d406e1529d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.618882 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8303aea-ccb2-4627-b028-75d406e1529d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.637470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-b8303aea-ccb2-4627-b028-75d406e1529d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:37:04.639068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 541/1087] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:04.645700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f020-bd17-4df0-8cbb-83f1e4af8709 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.657377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8f020-bd17-4df0-8cbb-83f1e4af8709 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.663375 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95f75c-89d1-4013-b280-0d9f9e2e4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.664058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95f75c-89d1-4013-b280-0d9f9e2e4a6f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.664339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95f75c-89d1-4013-b280-0d9f9e2e4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.664609 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e95f75c-89d1-4013-b280-0d9f9e2e4a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.665516 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95f75c-89d1-4013-b280-0d9f9e2e4a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:04.665852 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95f75c-89d1-4013-b280-0d9f9e2e4a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.667520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e95f75c-89d1-4013-b280-0d9f9e2e4a6f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.681808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 547/1088] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:04.689138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8303aea-ccb2-4627-b028-75d406e1529d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.704928 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8303aea-ccb2-4627-b028-75d406e1529d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.711131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26385a9e-6364-4cb2-b7a9-a56a93ff629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.711934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26385a9e-6364-4cb2-b7a9-a56a93ff629c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.712210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26385a9e-6364-4cb2-b7a9-a56a93ff629c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.712431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26385a9e-6364-4cb2-b7a9-a56a93ff629c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.724026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26385a9e-6364-4cb2-b7a9-a56a93ff629c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.727421 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26385a9e-6364-4cb2-b7a9-a56a93ff629c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.741713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-26385a9e-6364-4cb2-b7a9-a56a93ff629c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Dec 13 16:37:04.743134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 542/1089] 10.222.0.62 () {56 vars in 1114 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/users/nova => generated 82 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:04.749433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95f75c-89d1-4013-b280-0d9f9e2e4a6f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.760250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e95f75c-89d1-4013-b280-0d9f9e2e4a6f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.766343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c58df4-69c3-49b1-a226-a647b062260b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.767008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c58df4-69c3-49b1-a226-a647b062260b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.767286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c58df4-69c3-49b1-a226-a647b062260b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.767550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c58df4-69c3-49b1-a226-a647b062260b admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.768396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c58df4-69c3-49b1-a226-a647b062260b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:04.768736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c58df4-69c3-49b1-a226-a647b062260b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.770585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c58df4-69c3-49b1-a226-a647b062260b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.789561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 548/1090] 10.222.0.62 () {56 vars in 1154 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:04.795915 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26385a9e-6364-4cb2-b7a9-a56a93ff629c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.806424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26385a9e-6364-4cb2-b7a9-a56a93ff629c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.812219 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cec7d-7747-4ad8-a388-b6771eadb340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.812899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cec7d-7747-4ad8-a388-b6771eadb340 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.813174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cec7d-7747-4ad8-a388-b6771eadb340 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.813442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460cec7d-7747-4ad8-a388-b6771eadb340 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.822244 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cec7d-7747-4ad8-a388-b6771eadb340 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.823992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460cec7d-7747-4ad8-a388-b6771eadb340 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.832903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 543/1091] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:37:04.839454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c58df4-69c3-49b1-a226-a647b062260b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.849603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c58df4-69c3-49b1-a226-a647b062260b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.855698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53997a60-5868-4f20-8855-7b3b599da245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.856486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53997a60-5868-4f20-8855-7b3b599da245 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.856790 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53997a60-5868-4f20-8855-7b3b599da245 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.857057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53997a60-5868-4f20-8855-7b3b599da245 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.867977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53997a60-5868-4f20-8855-7b3b599da245 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.869891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53997a60-5868-4f20-8855-7b3b599da245 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.886963 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-53997a60-5868-4f20-8855-7b3b599da245 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:37:04.888121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 549/1092] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:04.894758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cec7d-7747-4ad8-a388-b6771eadb340 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.903777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460cec7d-7747-4ad8-a388-b6771eadb340 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.908886 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7851b12-2f67-4009-b0ba-bc1441ca5e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.909527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7851b12-2f67-4009-b0ba-bc1441ca5e95 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.909798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7851b12-2f67-4009-b0ba-bc1441ca5e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.910065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7851b12-2f67-4009-b0ba-bc1441ca5e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.910768 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7851b12-2f67-4009-b0ba-bc1441ca5e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:04.911065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7851b12-2f67-4009-b0ba-bc1441ca5e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.912840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7851b12-2f67-4009-b0ba-bc1441ca5e95 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.924816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 544/1093] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:04.930904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53997a60-5868-4f20-8855-7b3b599da245 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.941258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53997a60-5868-4f20-8855-7b3b599da245 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.946681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5fb19-f051-491d-a81f-d27e44c9155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.947464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5fb19-f051-491d-a81f-d27e44c9155c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.947749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5fb19-f051-491d-a81f-d27e44c9155c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.948026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5fb19-f051-491d-a81f-d27e44c9155c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.955381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5fb19-f051-491d-a81f-d27e44c9155c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.957384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5fb19-f051-491d-a81f-d27e44c9155c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:04.970582 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-59c5fb19-f051-491d-a81f-d27e44c9155c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:37:04.971941 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 550/1094] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:04.978338 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7851b12-2f67-4009-b0ba-bc1441ca5e95 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:04.988471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7851b12-2f67-4009-b0ba-bc1441ca5e95 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:04.994224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e80c0-b690-41fa-88f1-45fb657a66ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:04.994866 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e80c0-b690-41fa-88f1-45fb657a66ef admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:04.995141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e80c0-b690-41fa-88f1-45fb657a66ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:04.995406 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e80c0-b690-41fa-88f1-45fb657a66ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:04.996195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e80c0-b690-41fa-88f1-45fb657a66ef admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:04.996499 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e80c0-b690-41fa-88f1-45fb657a66ef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:04.998362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e80c0-b690-41fa-88f1-45fb657a66ef admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:05.010170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 545/1095] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:37:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:05.017068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5fb19-f051-491d-a81f-d27e44c9155c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:05.027580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5fb19-f051-491d-a81f-d27e44c9155c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:05.032478 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9dbd3-1b52-4a2c-93c6-d4441754e84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:05.033126 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9dbd3-1b52-4a2c-93c6-d4441754e84d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:05.033388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9dbd3-1b52-4a2c-93c6-d4441754e84d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:05.033678 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9dbd3-1b52-4a2c-93c6-d4441754e84d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:05.034495 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9dbd3-1b52-4a2c-93c6-d4441754e84d admin admin] RBAC: Adding query filter params (role.id=3e6310c0228e4643a7cd784cdf3aca43, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=dfecc747eb8d431a8d57f4534d259de8) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:05.034803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9dbd3-1b52-4a2c-93c6-d4441754e84d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:05.036695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9dbd3-1b52-4a2c-93c6-d4441754e84d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:05.042458 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 551/1096] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:37:05 2021] GET /identity/v3/role_assignments?user.id=dfecc747eb8d431a8d57f4534d259de8&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=3e6310c0228e4643a7cd784cdf3aca43 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:06.815891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f68454-fe1e-46a2-9e41-bee64dc42e31 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:06.816876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f68454-fe1e-46a2-9e41-bee64dc42e31 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:06.816876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f68454-fe1e-46a2-9e41-bee64dc42e31 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:06.820061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 546/1097] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:06 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:06.828841 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e01e1e-39cd-473b-931b-eafa907e2493 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:06.829301 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e01e1e-39cd-473b-931b-eafa907e2493 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:06.829391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e01e1e-39cd-473b-931b-eafa907e2493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:06.847933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-52e01e1e-39cd-473b-931b-eafa907e2493 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:06.849162 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-52e01e1e-39cd-473b-931b-eafa907e2493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:06.858202 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 552/1098] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:37:06.883433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f68454-fe1e-46a2-9e41-bee64dc42e31 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:06.903341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f68454-fe1e-46a2-9e41-bee64dc42e31 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:06.909468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e78b-b494-495f-a226-b28f756031b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:06.910236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e78b-b494-495f-a226-b28f756031b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:06.910465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e78b-b494-495f-a226-b28f756031b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:06.910770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e78b-b494-495f-a226-b28f756031b4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:06.928793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0e78b-b494-495f-a226-b28f756031b4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:37:06.935445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-bda0e78b-b494-495f-a226-b28f756031b4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:37:06.936595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 547/1099] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:37:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:06.943332 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e01e1e-39cd-473b-931b-eafa907e2493 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:06.952436 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e01e1e-39cd-473b-931b-eafa907e2493 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:06.958380 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77400c-d20c-447e-9ae3-3d91587afa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:06.959074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77400c-d20c-447e-9ae3-3d91587afa53 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:06.959458 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77400c-d20c-447e-9ae3-3d91587afa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:06.959731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77400c-d20c-447e-9ae3-3d91587afa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:06.960483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77400c-d20c-447e-9ae3-3d91587afa53 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:06.960816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77400c-d20c-447e-9ae3-3d91587afa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:06.962430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77400c-d20c-447e-9ae3-3d91587afa53 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:06.971071 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 553/1100] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:37:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:06.977612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e78b-b494-495f-a226-b28f756031b4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:06.988284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e78b-b494-495f-a226-b28f756031b4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:06.994486 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba2c85-bbae-4780-b06b-25eb5417143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:06.995305 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2c85-bbae-4780-b06b-25eb5417143b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:06.995576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2c85-bbae-4780-b06b-25eb5417143b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:06.995839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2c85-bbae-4780-b06b-25eb5417143b admin admin] PATH_INFO: `/v3/users/63fc4713416b411d93d191207efb5d18` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:06.997210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba2c85-bbae-4780-b06b-25eb5417143b admin admin] RBAC: Authorizing `identity:get_user(user_id=63fc4713416b411d93d191207efb5d18)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:06.999330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba2c85-bbae-4780-b06b-25eb5417143b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:07.000899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 548/1101] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:06 2021] GET /identity/v3/users/63fc4713416b411d93d191207efb5d18 => generated 285 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:07.007115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77400c-d20c-447e-9ae3-3d91587afa53 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:07.017373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77400c-d20c-447e-9ae3-3d91587afa53 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:07.023661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e495-460e-4455-8621-7a10a8e2ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:07.024266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e495-460e-4455-8621-7a10a8e2ed00 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:07.024541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e495-460e-4455-8621-7a10a8e2ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:07.024842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5e495-460e-4455-8621-7a10a8e2ed00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:07.033095 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5e495-460e-4455-8621-7a10a8e2ed00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:07.034808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5e495-460e-4455-8621-7a10a8e2ed00 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:07.043733 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 554/1102] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:37:07 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:37:07.050028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba2c85-bbae-4780-b06b-25eb5417143b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:07.060180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba2c85-bbae-4780-b06b-25eb5417143b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:07.066429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23590eec-fb0b-4734-9898-2431ada44451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:07.067160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23590eec-fb0b-4734-9898-2431ada44451 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:07.067436 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23590eec-fb0b-4734-9898-2431ada44451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:07.067699 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23590eec-fb0b-4734-9898-2431ada44451 admin admin] PATH_INFO: `/v3/projects/be87afc72018494fbd34d8cdd540d614` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:07.069187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23590eec-fb0b-4734-9898-2431ada44451 admin admin] RBAC: Authorizing `identity:get_project(project_id=be87afc72018494fbd34d8cdd540d614)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:07.071172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23590eec-fb0b-4734-9898-2431ada44451 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:07.072796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 549/1103] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:07 2021] GET /identity/v3/projects/be87afc72018494fbd34d8cdd540d614 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:07.079248 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e495-460e-4455-8621-7a10a8e2ed00 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:07.088139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5e495-460e-4455-8621-7a10a8e2ed00 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:07.094351 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b602f71-80d3-45c2-a817-956e7b6fc379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:07.094956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b602f71-80d3-45c2-a817-956e7b6fc379 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:07.095235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b602f71-80d3-45c2-a817-956e7b6fc379 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:07.095499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b602f71-80d3-45c2-a817-956e7b6fc379 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:07.096311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b602f71-80d3-45c2-a817-956e7b6fc379 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=be87afc72018494fbd34d8cdd540d614, user.id=63fc4713416b411d93d191207efb5d18) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:07.096626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b602f71-80d3-45c2-a817-956e7b6fc379 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:07.098466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b602f71-80d3-45c2-a817-956e7b6fc379 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:07.104602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 555/1104] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:37:07 2021] GET /identity/v3/role_assignments?user.id=63fc4713416b411d93d191207efb5d18&scope.project.id=be87afc72018494fbd34d8cdd540d614&role.id=f3311ba27a464113b884aa5a1144945d => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:09.457850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c6fb-22f7-4c0f-9508-887ee935e02a None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:09.458764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c6fb-22f7-4c0f-9508-887ee935e02a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:09.458764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11c6fb-22f7-4c0f-9508-887ee935e02a None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:09.462000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 550/1105] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:09 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:09.468816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fafe45-6976-4746-8044-7850c3ebc60b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:09.469280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fafe45-6976-4746-8044-7850c3ebc60b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:09.469378 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fafe45-6976-4746-8044-7850c3ebc60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:09.490211 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e8fafe45-6976-4746-8044-7850c3ebc60b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:09.491384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e8fafe45-6976-4746-8044-7850c3ebc60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:09.500165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 556/1106] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:09.526958 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11c6fb-22f7-4c0f-9508-887ee935e02a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:09.545348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11c6fb-22f7-4c0f-9508-887ee935e02a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:09.550643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00660e-94f9-4b29-b794-b0848115a280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:09.551413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00660e-94f9-4b29-b794-b0848115a280 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:09.551691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00660e-94f9-4b29-b794-b0848115a280 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:09.551957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00660e-94f9-4b29-b794-b0848115a280 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:09.553558 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00660e-94f9-4b29-b794-b0848115a280 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:09.555236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00660e-94f9-4b29-b794-b0848115a280 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:09.556806 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 551/1107] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:37:09 2021] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:09.562787 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fafe45-6976-4746-8044-7850c3ebc60b None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:09.572211 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fafe45-6976-4746-8044-7850c3ebc60b None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:09.577316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ddf05a-3f1a-4e0d-a21e-e2e3340938b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:09.577965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddf05a-3f1a-4e0d-a21e-e2e3340938b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:09.578239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddf05a-3f1a-4e0d-a21e-e2e3340938b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:09.578501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ddf05a-3f1a-4e0d-a21e-e2e3340938b4 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:09.579221 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddf05a-3f1a-4e0d-a21e-e2e3340938b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:09.581142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ddf05a-3f1a-4e0d-a21e-e2e3340938b4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:09.604722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 557/1108] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:37:09 2021] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:37:11.966310 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c2b8-a15d-4043-b8b2-0df7cb523f88 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:11.967248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c2b8-a15d-4043-b8b2-0df7cb523f88 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:11.967248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c2b8-a15d-4043-b8b2-0df7cb523f88 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:11.970016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 552/1109] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:11 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:11.977115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c88ad-36e1-413e-ae2c-bf2991eea881 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:11.977579 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c88ad-36e1-413e-ae2c-bf2991eea881 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:11.977678 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c88ad-36e1-413e-ae2c-bf2991eea881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:12.006990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-d12c88ad-36e1-413e-ae2c-bf2991eea881 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:12.008171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d12c88ad-36e1-413e-ae2c-bf2991eea881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:12.017710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 558/1110] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:12.045320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c2b8-a15d-4043-b8b2-0df7cb523f88 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:12.062964 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c2b8-a15d-4043-b8b2-0df7cb523f88 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:12.069577 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765abda9-9f02-42a0-9c16-c27b059ff35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:12.070433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765abda9-9f02-42a0-9c16-c27b059ff35e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:12.070711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765abda9-9f02-42a0-9c16-c27b059ff35e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:12.070978 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765abda9-9f02-42a0-9c16-c27b059ff35e admin admin] PATH_INFO: `/v3/roles/aa4c4022e45a4188814d7840a56322eb` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:12.072720 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765abda9-9f02-42a0-9c16-c27b059ff35e admin admin] RBAC: Authorizing `identity:get_role(role_id=aa4c4022e45a4188814d7840a56322eb)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:12.073746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-765abda9-9f02-42a0-9c16-c27b059ff35e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:37:12.073746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:37:12.073746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:37:12.074616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765abda9-9f02-42a0-9c16-c27b059ff35e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:12.075932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 553/1111] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:12 2021] GET /identity/v3/roles/aa4c4022e45a4188814d7840a56322eb => generated 223 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:12.085338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c88ad-36e1-413e-ae2c-bf2991eea881 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:12.095219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c88ad-36e1-413e-ae2c-bf2991eea881 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:12.101376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da533ead-3086-4136-9824-9479ea7df12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:12.102266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da533ead-3086-4136-9824-9479ea7df12b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:12.102540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da533ead-3086-4136-9824-9479ea7df12b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:12.102817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da533ead-3086-4136-9824-9479ea7df12b admin admin] PATH_INFO: `/v3/users/71e242b7d3e145789ae2ca89a4fb2f31` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:12.118451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da533ead-3086-4136-9824-9479ea7df12b admin admin] RBAC: Authorizing `identity:get_user(user_id=71e242b7d3e145789ae2ca89a4fb2f31)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:12.120710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da533ead-3086-4136-9824-9479ea7df12b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:12.122432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 559/1112] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:12 2021] GET /identity/v3/users/71e242b7d3e145789ae2ca89a4fb2f31 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:12.128921 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765abda9-9f02-42a0-9c16-c27b059ff35e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:12.139239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765abda9-9f02-42a0-9c16-c27b059ff35e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:12.145333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6fc2b-a6fc-49fe-a0fe-6b2f684fcb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:12.145977 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6fc2b-a6fc-49fe-a0fe-6b2f684fcb75 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:12.146296 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6fc2b-a6fc-49fe-a0fe-6b2f684fcb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:12.146711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6fc2b-a6fc-49fe-a0fe-6b2f684fcb75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:12.155635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6fc2b-a6fc-49fe-a0fe-6b2f684fcb75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:12.157402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6fc2b-a6fc-49fe-a0fe-6b2f684fcb75 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:12.167187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 554/1113] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:37:12 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:37:12.173498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da533ead-3086-4136-9824-9479ea7df12b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:12.185005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da533ead-3086-4136-9824-9479ea7df12b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:12.191215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7d879-3f34-475e-afc8-e2caebcaad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:12.192046 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7d879-3f34-475e-afc8-e2caebcaad4e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:12.192317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7d879-3f34-475e-afc8-e2caebcaad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:12.192604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7d879-3f34-475e-afc8-e2caebcaad4e admin admin] PATH_INFO: `/v3/projects/be87afc72018494fbd34d8cdd540d614` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:12.193978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7d879-3f34-475e-afc8-e2caebcaad4e admin admin] RBAC: Authorizing `identity:get_project(project_id=be87afc72018494fbd34d8cdd540d614)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:12.195986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7d879-3f34-475e-afc8-e2caebcaad4e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:12.197653 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 560/1114] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:12 2021] GET /identity/v3/projects/be87afc72018494fbd34d8cdd540d614 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:12.207997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6fc2b-a6fc-49fe-a0fe-6b2f684fcb75 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:12.218395 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6fc2b-a6fc-49fe-a0fe-6b2f684fcb75 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:12.224925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d8e97-500f-4ad3-9db6-30be3c5d5a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:12.225556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d8e97-500f-4ad3-9db6-30be3c5d5a67 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:12.225832 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d8e97-500f-4ad3-9db6-30be3c5d5a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:12.226098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d8e97-500f-4ad3-9db6-30be3c5d5a67 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:12.226941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d8e97-500f-4ad3-9db6-30be3c5d5a67 admin admin] RBAC: Adding query filter params (role.id=aa4c4022e45a4188814d7840a56322eb, scope.project.id=be87afc72018494fbd34d8cdd540d614, user.id=71e242b7d3e145789ae2ca89a4fb2f31) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:12.227254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d8e97-500f-4ad3-9db6-30be3c5d5a67 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:12.229086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d8e97-500f-4ad3-9db6-30be3c5d5a67 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:12.235390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 555/1115] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:37:12 2021] GET /identity/v3/role_assignments?user.id=71e242b7d3e145789ae2ca89a4fb2f31&scope.project.id=be87afc72018494fbd34d8cdd540d614&role.id=aa4c4022e45a4188814d7840a56322eb => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:14.556886 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302916-28f2-4975-9e9d-3492816112dc None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:14.557474 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302916-28f2-4975-9e9d-3492816112dc None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:14.557474 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302916-28f2-4975-9e9d-3492816112dc None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:14.559178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 561/1116] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:14.566160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534afc27-385c-4482-86bd-650cf4ca512a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:14.566874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534afc27-385c-4482-86bd-650cf4ca512a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:14.567027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534afc27-385c-4482-86bd-650cf4ca512a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:14.592474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-534afc27-385c-4482-86bd-650cf4ca512a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:14.593606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-534afc27-385c-4482-86bd-650cf4ca512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:14.602516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 556/1117] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:14 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:14.626015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e302916-28f2-4975-9e9d-3492816112dc None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:14.640444 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e302916-28f2-4975-9e9d-3492816112dc None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:14.645951 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b339b-09a8-48ce-a2b3-cfd053b38c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:14.646857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b339b-09a8-48ce-a2b3-cfd053b38c43 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:14.647103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b339b-09a8-48ce-a2b3-cfd053b38c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:14.647393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b339b-09a8-48ce-a2b3-cfd053b38c43 admin admin] PATH_INFO: `/v3/roles/aa4c4022e45a4188814d7840a56322eb` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:14.648925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b339b-09a8-48ce-a2b3-cfd053b38c43 admin admin] RBAC: Authorizing `identity:get_role(role_id=aa4c4022e45a4188814d7840a56322eb)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:14.649934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-9a7b339b-09a8-48ce-a2b3-cfd053b38c43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:37:14.649934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:37:14.649934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:37:14.650787 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b339b-09a8-48ce-a2b3-cfd053b38c43 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:14.652090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 562/1118] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:14 2021] GET /identity/v3/roles/aa4c4022e45a4188814d7840a56322eb => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:14.658820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534afc27-385c-4482-86bd-650cf4ca512a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:14.669669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534afc27-385c-4482-86bd-650cf4ca512a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:14.675710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753542af-8966-4c42-9462-db5d6a81f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:14.676554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753542af-8966-4c42-9462-db5d6a81f439 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:14.676862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753542af-8966-4c42-9462-db5d6a81f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:14.677145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753542af-8966-4c42-9462-db5d6a81f439 admin admin] PATH_INFO: `/v3/users/71e242b7d3e145789ae2ca89a4fb2f31` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:14.678457 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753542af-8966-4c42-9462-db5d6a81f439 admin admin] RBAC: Authorizing `identity:get_user(user_id=71e242b7d3e145789ae2ca89a4fb2f31)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:14.680553 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753542af-8966-4c42-9462-db5d6a81f439 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:14.682151 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 557/1119] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:14 2021] GET /identity/v3/users/71e242b7d3e145789ae2ca89a4fb2f31 => generated 286 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:14.687986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b339b-09a8-48ce-a2b3-cfd053b38c43 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:14.697629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b339b-09a8-48ce-a2b3-cfd053b38c43 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:14.702523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abccb35-c152-44b5-945d-3b75549ae454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:14.703315 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abccb35-c152-44b5-945d-3b75549ae454 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:14.703584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abccb35-c152-44b5-945d-3b75549ae454 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:14.703850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abccb35-c152-44b5-945d-3b75549ae454 admin admin] PATH_INFO: `/v3/projects/be87afc72018494fbd34d8cdd540d614` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:14.705074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abccb35-c152-44b5-945d-3b75549ae454 admin admin] RBAC: Authorizing `identity:get_project(project_id=be87afc72018494fbd34d8cdd540d614)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:14.707041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abccb35-c152-44b5-945d-3b75549ae454 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:14.708662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 563/1120] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:14 2021] GET /identity/v3/projects/be87afc72018494fbd34d8cdd540d614 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:14.715024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753542af-8966-4c42-9462-db5d6a81f439 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:14.726276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753542af-8966-4c42-9462-db5d6a81f439 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:14.732042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe40a5-7700-4b4b-aba9-fbc08d4f3948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:14.732955 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe40a5-7700-4b4b-aba9-fbc08d4f3948 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:14.733236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe40a5-7700-4b4b-aba9-fbc08d4f3948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:14.733508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe40a5-7700-4b4b-aba9-fbc08d4f3948 admin admin] PATH_INFO: `/v3/projects/be87afc72018494fbd34d8cdd540d614/users/71e242b7d3e145789ae2ca89a4fb2f31/roles/aa4c4022e45a4188814d7840a56322eb` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:14.736365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe40a5-7700-4b4b-aba9-fbc08d4f3948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be87afc72018494fbd34d8cdd540d614, user_id=71e242b7d3e145789ae2ca89a4fb2f31, role_id=aa4c4022e45a4188814d7840a56322eb)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:14.739016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe40a5-7700-4b4b-aba9-fbc08d4f3948 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:14.756091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 558/1121] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:37:14 2021] PUT /identity/v3/projects/be87afc72018494fbd34d8cdd540d614/users/71e242b7d3e145789ae2ca89a4fb2f31/roles/aa4c4022e45a4188814d7840a56322eb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:37:17.062851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ddad1-1dbe-4399-85f5-930974020dc5 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:17.063447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ddad1-1dbe-4399-85f5-930974020dc5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:17.063447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ddad1-1dbe-4399-85f5-930974020dc5 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:17.065194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 564/1122] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:17.072556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f833b9-a227-47b7-b298-3fddae5beda3 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:17.073350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f833b9-a227-47b7-b298-3fddae5beda3 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:17.073505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f833b9-a227-47b7-b298-3fddae5beda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:17.102207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-e6f833b9-a227-47b7-b298-3fddae5beda3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:17.103388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e6f833b9-a227-47b7-b298-3fddae5beda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:17.173406 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 559/1123] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:17 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:17.198583 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ddad1-1dbe-4399-85f5-930974020dc5 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:17.213044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ddad1-1dbe-4399-85f5-930974020dc5 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:17.218141 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01dce7-7f71-4730-a047-7b47d7ce1794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:17.218976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01dce7-7f71-4730-a047-7b47d7ce1794 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:17.219247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01dce7-7f71-4730-a047-7b47d7ce1794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:17.219516 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01dce7-7f71-4730-a047-7b47d7ce1794 admin admin] PATH_INFO: `/v3/roles/aa4c4022e45a4188814d7840a56322eb` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:17.221047 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01dce7-7f71-4730-a047-7b47d7ce1794 admin admin] RBAC: Authorizing `identity:get_role(role_id=aa4c4022e45a4188814d7840a56322eb)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:17.222692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01dce7-7f71-4730-a047-7b47d7ce1794 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:17.224054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 565/1124] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:17 2021] GET /identity/v3/roles/aa4c4022e45a4188814d7840a56322eb => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:17.231397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f833b9-a227-47b7-b298-3fddae5beda3 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:17.247748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f833b9-a227-47b7-b298-3fddae5beda3 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:17.258403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090ed4f-22ac-4221-9c6c-9c84516ac694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:17.259397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090ed4f-22ac-4221-9c6c-9c84516ac694 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:17.259928 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090ed4f-22ac-4221-9c6c-9c84516ac694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:17.260557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090ed4f-22ac-4221-9c6c-9c84516ac694 admin admin] PATH_INFO: `/v3/users/71e242b7d3e145789ae2ca89a4fb2f31` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:17.262359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090ed4f-22ac-4221-9c6c-9c84516ac694 admin admin] RBAC: Authorizing `identity:get_user(user_id=71e242b7d3e145789ae2ca89a4fb2f31)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:17.265016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090ed4f-22ac-4221-9c6c-9c84516ac694 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:17.266594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 560/1125] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:17 2021] GET /identity/v3/users/71e242b7d3e145789ae2ca89a4fb2f31 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:17.273074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01dce7-7f71-4730-a047-7b47d7ce1794 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:17.283903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01dce7-7f71-4730-a047-7b47d7ce1794 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:17.290064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b417c-d5f5-4a14-a889-f8350a3312e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:17.290682 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b417c-d5f5-4a14-a889-f8350a3312e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:17.290954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b417c-d5f5-4a14-a889-f8350a3312e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:17.291223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b417c-d5f5-4a14-a889-f8350a3312e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:17.300122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b417c-d5f5-4a14-a889-f8350a3312e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:17.301876 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b417c-d5f5-4a14-a889-f8350a3312e6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:17.310890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 566/1126] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:37:17 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:37:17.317246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090ed4f-22ac-4221-9c6c-9c84516ac694 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:17.330248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090ed4f-22ac-4221-9c6c-9c84516ac694 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:17.337149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa305cf-e85b-44ad-ba2c-413f72241bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:17.338003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa305cf-e85b-44ad-ba2c-413f72241bca admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:17.338281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa305cf-e85b-44ad-ba2c-413f72241bca admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:17.338554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa305cf-e85b-44ad-ba2c-413f72241bca admin admin] PATH_INFO: `/v3/projects/be87afc72018494fbd34d8cdd540d614` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:17.339895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa305cf-e85b-44ad-ba2c-413f72241bca admin admin] RBAC: Authorizing `identity:get_project(project_id=be87afc72018494fbd34d8cdd540d614)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:17.341960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa305cf-e85b-44ad-ba2c-413f72241bca admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:17.343662 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 561/1127] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:17 2021] GET /identity/v3/projects/be87afc72018494fbd34d8cdd540d614 => generated 311 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:17.350514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b417c-d5f5-4a14-a889-f8350a3312e6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:17.362174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b417c-d5f5-4a14-a889-f8350a3312e6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:17.368877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3bc3e-fcf8-4d32-811d-6aecca8b5d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:17.369525 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3bc3e-fcf8-4d32-811d-6aecca8b5d35 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:17.369803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3bc3e-fcf8-4d32-811d-6aecca8b5d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:17.370073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3bc3e-fcf8-4d32-811d-6aecca8b5d35 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:17.370910 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3bc3e-fcf8-4d32-811d-6aecca8b5d35 admin admin] RBAC: Adding query filter params (role.id=aa4c4022e45a4188814d7840a56322eb, scope.project.id=be87afc72018494fbd34d8cdd540d614, user.id=71e242b7d3e145789ae2ca89a4fb2f31) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:17.371222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3bc3e-fcf8-4d32-811d-6aecca8b5d35 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:17.373109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3bc3e-fcf8-4d32-811d-6aecca8b5d35 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:17.379413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 567/1128] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:37:17 2021] GET /identity/v3/role_assignments?user.id=71e242b7d3e145789ae2ca89a4fb2f31&scope.project.id=be87afc72018494fbd34d8cdd540d614&role.id=aa4c4022e45a4188814d7840a56322eb => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:19.733731 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576f82-286c-450d-a720-27dcc981872c None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:19.734306 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576f82-286c-450d-a720-27dcc981872c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:19.734306 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52576f82-286c-450d-a720-27dcc981872c None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:19.736058 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 562/1129] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:19.743019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd51e-2f0e-4d13-a753-feb6ca28f78c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:19.743744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd51e-2f0e-4d13-a753-feb6ca28f78c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:19.743924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbd51e-2f0e-4d13-a753-feb6ca28f78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:19.773104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-80cbd51e-2f0e-4d13-a753-feb6ca28f78c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:19.774278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-80cbd51e-2f0e-4d13-a753-feb6ca28f78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:19.783132 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 568/1130] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:19.814636 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52576f82-286c-450d-a720-27dcc981872c None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:19.828980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52576f82-286c-450d-a720-27dcc981872c None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:19.834187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748801e9-7525-4245-9bf9-0e3cb26e5dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:19.834961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748801e9-7525-4245-9bf9-0e3cb26e5dfc admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:19.835234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748801e9-7525-4245-9bf9-0e3cb26e5dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:19.835501 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748801e9-7525-4245-9bf9-0e3cb26e5dfc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:19.836793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748801e9-7525-4245-9bf9-0e3cb26e5dfc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:19.838473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748801e9-7525-4245-9bf9-0e3cb26e5dfc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:19.840041 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 563/1131] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:37:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:19.850201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbd51e-2f0e-4d13-a753-feb6ca28f78c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:19.865110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbd51e-2f0e-4d13-a753-feb6ca28f78c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:19.870987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5baa266-4b99-4383-9762-054bd153e085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:19.871631 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baa266-4b99-4383-9762-054bd153e085 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:19.871909 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baa266-4b99-4383-9762-054bd153e085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:19.872172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baa266-4b99-4383-9762-054bd153e085 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:19.872930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5baa266-4b99-4383-9762-054bd153e085 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:19.874808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5baa266-4b99-4383-9762-054bd153e085 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:19.903611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 569/1132] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:37:19 2021] POST /identity/v3/projects => generated 311 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:37:22.457643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53fc12-91f6-47eb-a30a-04dd26fd43c9 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:22.459312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53fc12-91f6-47eb-a30a-04dd26fd43c9 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:22.459312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c53fc12-91f6-47eb-a30a-04dd26fd43c9 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:22.462169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 564/1133] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:22 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:22.473513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f221f5f-6798-4c9b-9921-7ac4c6517f42 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:22.474110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f221f5f-6798-4c9b-9921-7ac4c6517f42 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:22.474322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f221f5f-6798-4c9b-9921-7ac4c6517f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:22.493310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-1f221f5f-6798-4c9b-9921-7ac4c6517f42 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:22.494491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1f221f5f-6798-4c9b-9921-7ac4c6517f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:22.560081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 570/1134] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:22.596251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53fc12-91f6-47eb-a30a-04dd26fd43c9 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:22.613464 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c53fc12-91f6-47eb-a30a-04dd26fd43c9 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:22.618988 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e2810-f1cd-42a7-b30b-e20a4fe4c52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:22.619764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e2810-f1cd-42a7-b30b-e20a4fe4c52c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:22.620048 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e2810-f1cd-42a7-b30b-e20a4fe4c52c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:22.620317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e2810-f1cd-42a7-b30b-e20a4fe4c52c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:22.621610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e2810-f1cd-42a7-b30b-e20a4fe4c52c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:22.623273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e2810-f1cd-42a7-b30b-e20a4fe4c52c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:22.624927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 565/1135] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:37:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:22.631606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f221f5f-6798-4c9b-9921-7ac4c6517f42 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:22.641744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f221f5f-6798-4c9b-9921-7ac4c6517f42 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:22.648859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da2c2e-16a8-448f-b749-5952521ec9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:22.649488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2c2e-16a8-448f-b749-5952521ec9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:22.649765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2c2e-16a8-448f-b749-5952521ec9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:22.650035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2c2e-16a8-448f-b749-5952521ec9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:22.650753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da2c2e-16a8-448f-b749-5952521ec9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:22.652680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da2c2e-16a8-448f-b749-5952521ec9b4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:22.677815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 571/1136] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:37:22 2021] POST /identity/v3/users => generated 286 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:37:25.051118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6bae3-8303-4a90-96a9-b2cbfee72c31 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:25.052527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6bae3-8303-4a90-96a9-b2cbfee72c31 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:25.052527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6bae3-8303-4a90-96a9-b2cbfee72c31 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:25.054831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 566/1137] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:25 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:25.064272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387903e5-cfe0-4f92-a213-54699d94a1ec None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:25.064729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387903e5-cfe0-4f92-a213-54699d94a1ec None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:25.064877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387903e5-cfe0-4f92-a213-54699d94a1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:25.090572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-387903e5-cfe0-4f92-a213-54699d94a1ec None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:25.091747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-387903e5-cfe0-4f92-a213-54699d94a1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:25.100834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 572/1138] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:25 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:25.125517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6bae3-8303-4a90-96a9-b2cbfee72c31 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:25.146937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6bae3-8303-4a90-96a9-b2cbfee72c31 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:25.152724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888eade-c556-4b1d-9ecf-9c274f826704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:25.153498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888eade-c556-4b1d-9ecf-9c274f826704 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:25.153770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888eade-c556-4b1d-9ecf-9c274f826704 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:25.154037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888eade-c556-4b1d-9ecf-9c274f826704 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:25.165575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888eade-c556-4b1d-9ecf-9c274f826704 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:37:25.172273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-7888eade-c556-4b1d-9ecf-9c274f826704 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:37:25.173422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 567/1139] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:37:25 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:25.182957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387903e5-cfe0-4f92-a213-54699d94a1ec None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:25.192922 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387903e5-cfe0-4f92-a213-54699d94a1ec None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:25.199269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee2a0f-d0d6-4a8e-b182-de5be4e8c6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:25.199925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2a0f-d0d6-4a8e-b182-de5be4e8c6ad admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:25.200195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2a0f-d0d6-4a8e-b182-de5be4e8c6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:25.200468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2a0f-d0d6-4a8e-b182-de5be4e8c6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:25.201263 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee2a0f-d0d6-4a8e-b182-de5be4e8c6ad admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:25.201565 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee2a0f-d0d6-4a8e-b182-de5be4e8c6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:25.203175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee2a0f-d0d6-4a8e-b182-de5be4e8c6ad admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:25.213025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 573/1140] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:37:25 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:25.219466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888eade-c556-4b1d-9ecf-9c274f826704 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:25.230771 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888eade-c556-4b1d-9ecf-9c274f826704 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:25.236545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dcaaf-2da6-4019-a289-03178a13d79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:25.237414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dcaaf-2da6-4019-a289-03178a13d79d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:25.237682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dcaaf-2da6-4019-a289-03178a13d79d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:25.237947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9dcaaf-2da6-4019-a289-03178a13d79d admin admin] PATH_INFO: `/v3/users/c3b5ba0287ca46e8bd5bf6ed186412e9` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:25.253769 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9dcaaf-2da6-4019-a289-03178a13d79d admin admin] RBAC: Authorizing `identity:get_user(user_id=c3b5ba0287ca46e8bd5bf6ed186412e9)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:25.255976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9dcaaf-2da6-4019-a289-03178a13d79d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:25.257594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 568/1141] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:25 2021] GET /identity/v3/users/c3b5ba0287ca46e8bd5bf6ed186412e9 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:25.264551 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee2a0f-d0d6-4a8e-b182-de5be4e8c6ad admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:25.280535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee2a0f-d0d6-4a8e-b182-de5be4e8c6ad admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:25.288841 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ec14e-8da5-43b4-b105-b69a63e7c436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:25.289473 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec14e-8da5-43b4-b105-b69a63e7c436 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:25.289753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec14e-8da5-43b4-b105-b69a63e7c436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:25.290018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ec14e-8da5-43b4-b105-b69a63e7c436 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:25.298481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ec14e-8da5-43b4-b105-b69a63e7c436 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:25.300220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ec14e-8da5-43b4-b105-b69a63e7c436 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:25.309432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 574/1142] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:37:25 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:37:25.318420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dcaaf-2da6-4019-a289-03178a13d79d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:25.329265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9dcaaf-2da6-4019-a289-03178a13d79d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:25.334413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767b69d-60f8-4942-a515-ff0c7a2b0c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:25.335256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767b69d-60f8-4942-a515-ff0c7a2b0c3a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:25.335534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767b69d-60f8-4942-a515-ff0c7a2b0c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:25.335807 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767b69d-60f8-4942-a515-ff0c7a2b0c3a admin admin] PATH_INFO: `/v3/projects/34a7c8aba7114078a2c17c2635d4b753` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:25.337101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767b69d-60f8-4942-a515-ff0c7a2b0c3a admin admin] RBAC: Authorizing `identity:get_project(project_id=34a7c8aba7114078a2c17c2635d4b753)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:25.339125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767b69d-60f8-4942-a515-ff0c7a2b0c3a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:25.340799 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 569/1143] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:25 2021] GET /identity/v3/projects/34a7c8aba7114078a2c17c2635d4b753 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:25.347380 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ec14e-8da5-43b4-b105-b69a63e7c436 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:25.356754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ec14e-8da5-43b4-b105-b69a63e7c436 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:25.362654 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eba636-a1cb-4611-a8cc-cdf969b1c758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:25.363290 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eba636-a1cb-4611-a8cc-cdf969b1c758 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:25.363572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eba636-a1cb-4611-a8cc-cdf969b1c758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:25.363840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eba636-a1cb-4611-a8cc-cdf969b1c758 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:25.364818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eba636-a1cb-4611-a8cc-cdf969b1c758 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=34a7c8aba7114078a2c17c2635d4b753, user.id=c3b5ba0287ca46e8bd5bf6ed186412e9) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:25.365157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eba636-a1cb-4611-a8cc-cdf969b1c758 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:25.367021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eba636-a1cb-4611-a8cc-cdf969b1c758 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:25.372772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 575/1144] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:37:25 2021] GET /identity/v3/role_assignments?user.id=c3b5ba0287ca46e8bd5bf6ed186412e9&scope.project.id=34a7c8aba7114078a2c17c2635d4b753&role.id=f3311ba27a464113b884aa5a1144945d => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:27.658784 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6868a-a98d-47d3-9750-398f76e70137 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:27.659311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6868a-a98d-47d3-9750-398f76e70137 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:27.659311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6868a-a98d-47d3-9750-398f76e70137 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:27.661124 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 570/1145] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:27.667981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd318d8-e079-460f-9b53-426ad36ae0a0 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:27.668730 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd318d8-e079-460f-9b53-426ad36ae0a0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:27.668890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd318d8-e079-460f-9b53-426ad36ae0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:27.695495 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7fd318d8-e079-460f-9b53-426ad36ae0a0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:27.696705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7fd318d8-e079-460f-9b53-426ad36ae0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:27.704518 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 576/1146] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:27.727838 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6868a-a98d-47d3-9750-398f76e70137 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:27.741470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6868a-a98d-47d3-9750-398f76e70137 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:27.746410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402ebec-55a0-456b-8403-0883d5f9f4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:27.747196 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402ebec-55a0-456b-8403-0883d5f9f4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:27.747470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402ebec-55a0-456b-8403-0883d5f9f4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:27.747797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402ebec-55a0-456b-8403-0883d5f9f4c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:27.760973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402ebec-55a0-456b-8403-0883d5f9f4c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:37:27.767968 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-3402ebec-55a0-456b-8403-0883d5f9f4c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:37:27.769126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 571/1147] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:37:27 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:27.776108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd318d8-e079-460f-9b53-426ad36ae0a0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:27.790178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd318d8-e079-460f-9b53-426ad36ae0a0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:27.797549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a6b06-0c92-406d-9bf7-dc6392a69ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:27.798207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a6b06-0c92-406d-9bf7-dc6392a69ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:27.798486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a6b06-0c92-406d-9bf7-dc6392a69ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:27.798758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a6b06-0c92-406d-9bf7-dc6392a69ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:27.799516 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a6b06-0c92-406d-9bf7-dc6392a69ba2 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:27.799817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a6b06-0c92-406d-9bf7-dc6392a69ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:27.801447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a6b06-0c92-406d-9bf7-dc6392a69ba2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:27.810317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 577/1148] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:37:27 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:27.816377 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402ebec-55a0-456b-8403-0883d5f9f4c0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:27.827038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402ebec-55a0-456b-8403-0883d5f9f4c0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:27.832737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c8787-a4d6-477f-9d83-d6b35560ebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:27.833811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8787-a4d6-477f-9d83-d6b35560ebdd admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:27.834087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8787-a4d6-477f-9d83-d6b35560ebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:27.834358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c8787-a4d6-477f-9d83-d6b35560ebdd admin admin] PATH_INFO: `/v3/users/c3b5ba0287ca46e8bd5bf6ed186412e9` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:27.835686 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c8787-a4d6-477f-9d83-d6b35560ebdd admin admin] RBAC: Authorizing `identity:get_user(user_id=c3b5ba0287ca46e8bd5bf6ed186412e9)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:27.837830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c8787-a4d6-477f-9d83-d6b35560ebdd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:27.839366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 572/1149] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:27 2021] GET /identity/v3/users/c3b5ba0287ca46e8bd5bf6ed186412e9 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:27.845312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a6b06-0c92-406d-9bf7-dc6392a69ba2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:27.855625 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a6b06-0c92-406d-9bf7-dc6392a69ba2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:27.861007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab215d-3034-4e8d-853c-71fcb3b0e828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:27.861860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab215d-3034-4e8d-853c-71fcb3b0e828 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:27.862135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab215d-3034-4e8d-853c-71fcb3b0e828 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:27.862410 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab215d-3034-4e8d-853c-71fcb3b0e828 admin admin] PATH_INFO: `/v3/projects/34a7c8aba7114078a2c17c2635d4b753` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:27.863572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab215d-3034-4e8d-853c-71fcb3b0e828 admin admin] RBAC: Authorizing `identity:get_project(project_id=34a7c8aba7114078a2c17c2635d4b753)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:27.865671 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab215d-3034-4e8d-853c-71fcb3b0e828 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:27.867292 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 578/1150] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:27 2021] GET /identity/v3/projects/34a7c8aba7114078a2c17c2635d4b753 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:27.877155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c8787-a4d6-477f-9d83-d6b35560ebdd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:27.894379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c8787-a4d6-477f-9d83-d6b35560ebdd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:27.901531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d8fa7-06aa-4b1e-a235-5a8020b4fc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:27.902388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d8fa7-06aa-4b1e-a235-5a8020b4fc87 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:27.902670 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d8fa7-06aa-4b1e-a235-5a8020b4fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:27.902943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d8fa7-06aa-4b1e-a235-5a8020b4fc87 admin admin] PATH_INFO: `/v3/projects/34a7c8aba7114078a2c17c2635d4b753/users/c3b5ba0287ca46e8bd5bf6ed186412e9/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:27.905354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d8fa7-06aa-4b1e-a235-5a8020b4fc87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34a7c8aba7114078a2c17c2635d4b753, user_id=c3b5ba0287ca46e8bd5bf6ed186412e9, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:27.907957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d8fa7-06aa-4b1e-a235-5a8020b4fc87 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:27.928370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 573/1151] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:37:27 2021] PUT /identity/v3/projects/34a7c8aba7114078a2c17c2635d4b753/users/c3b5ba0287ca46e8bd5bf6ed186412e9/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:37:30.249250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c0d08-0486-4b6b-ad2d-238cf3207663 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:30.250180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c0d08-0486-4b6b-ad2d-238cf3207663 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:30.250180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c0d08-0486-4b6b-ad2d-238cf3207663 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:30.252938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 579/1152] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:30 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:30.259764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd8be7-cf18-4382-9a7f-e429233a527f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:30.260533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd8be7-cf18-4382-9a7f-e429233a527f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:30.260704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd8be7-cf18-4382-9a7f-e429233a527f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:30.283555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-23cd8be7-cf18-4382-9a7f-e429233a527f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:30.284781 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-23cd8be7-cf18-4382-9a7f-e429233a527f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:30.345807 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 574/1153] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:30.377570 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c0d08-0486-4b6b-ad2d-238cf3207663 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:30.391501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c0d08-0486-4b6b-ad2d-238cf3207663 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:30.396277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79602a0a-b66e-4341-98c0-01329bd5992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:30.397086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79602a0a-b66e-4341-98c0-01329bd5992e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:30.397359 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79602a0a-b66e-4341-98c0-01329bd5992e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:30.397646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79602a0a-b66e-4341-98c0-01329bd5992e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:30.407618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79602a0a-b66e-4341-98c0-01329bd5992e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:37:30.414488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-79602a0a-b66e-4341-98c0-01329bd5992e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:37:30.415627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 580/1154] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:37:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:30.422089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd8be7-cf18-4382-9a7f-e429233a527f None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:30.431979 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd8be7-cf18-4382-9a7f-e429233a527f None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:30.437881 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2283fba-fc8c-4284-a4d3-ab3963f94901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:30.438538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2283fba-fc8c-4284-a4d3-ab3963f94901 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:30.438813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2283fba-fc8c-4284-a4d3-ab3963f94901 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:30.439076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2283fba-fc8c-4284-a4d3-ab3963f94901 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:30.439836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2283fba-fc8c-4284-a4d3-ab3963f94901 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:30.440138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2283fba-fc8c-4284-a4d3-ab3963f94901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:30.441752 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2283fba-fc8c-4284-a4d3-ab3963f94901 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:30.450841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 575/1155] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:37:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:30.457346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79602a0a-b66e-4341-98c0-01329bd5992e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:30.468026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79602a0a-b66e-4341-98c0-01329bd5992e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:30.473901 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feeba5-a1ff-41e1-bdbc-703a059ca561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:30.474730 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feeba5-a1ff-41e1-bdbc-703a059ca561 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:30.475008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feeba5-a1ff-41e1-bdbc-703a059ca561 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:30.475272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00feeba5-a1ff-41e1-bdbc-703a059ca561 admin admin] PATH_INFO: `/v3/users/c3b5ba0287ca46e8bd5bf6ed186412e9` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:30.476607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feeba5-a1ff-41e1-bdbc-703a059ca561 admin admin] RBAC: Authorizing `identity:get_user(user_id=c3b5ba0287ca46e8bd5bf6ed186412e9)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:30.478726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00feeba5-a1ff-41e1-bdbc-703a059ca561 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:30.480281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 581/1156] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:30 2021] GET /identity/v3/users/c3b5ba0287ca46e8bd5bf6ed186412e9 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:30.486300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2283fba-fc8c-4284-a4d3-ab3963f94901 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:30.495721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2283fba-fc8c-4284-a4d3-ab3963f94901 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:30.500664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4a815-3481-49e6-85ac-db981d266faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:30.501237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4a815-3481-49e6-85ac-db981d266faa admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:30.501509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4a815-3481-49e6-85ac-db981d266faa admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:30.501783 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4a815-3481-49e6-85ac-db981d266faa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:30.509900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4a815-3481-49e6-85ac-db981d266faa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:30.511594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4a815-3481-49e6-85ac-db981d266faa admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:30.520725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 576/1157] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:37:30 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:37:30.526895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feeba5-a1ff-41e1-bdbc-703a059ca561 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:30.537675 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00feeba5-a1ff-41e1-bdbc-703a059ca561 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:30.543932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1ccd7-599d-4320-af72-44eed48a4af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:30.544760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1ccd7-599d-4320-af72-44eed48a4af5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:30.545032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1ccd7-599d-4320-af72-44eed48a4af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:30.545294 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1ccd7-599d-4320-af72-44eed48a4af5 admin admin] PATH_INFO: `/v3/projects/34a7c8aba7114078a2c17c2635d4b753` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:30.546616 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1ccd7-599d-4320-af72-44eed48a4af5 admin admin] RBAC: Authorizing `identity:get_project(project_id=34a7c8aba7114078a2c17c2635d4b753)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:30.548629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1ccd7-599d-4320-af72-44eed48a4af5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:30.550235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 582/1158] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:30 2021] GET /identity/v3/projects/34a7c8aba7114078a2c17c2635d4b753 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:30.556811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4a815-3481-49e6-85ac-db981d266faa admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:30.565224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4a815-3481-49e6-85ac-db981d266faa admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:30.570591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd3c35-10e0-4aab-857f-7b3f109f9aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:30.571194 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3c35-10e0-4aab-857f-7b3f109f9aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:30.571474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3c35-10e0-4aab-857f-7b3f109f9aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:30.571741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd3c35-10e0-4aab-857f-7b3f109f9aa8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:30.572544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd3c35-10e0-4aab-857f-7b3f109f9aa8 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=34a7c8aba7114078a2c17c2635d4b753, user.id=c3b5ba0287ca46e8bd5bf6ed186412e9) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:30.572879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd3c35-10e0-4aab-857f-7b3f109f9aa8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:30.574637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd3c35-10e0-4aab-857f-7b3f109f9aa8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:30.580679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 577/1159] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:37:30 2021] GET /identity/v3/role_assignments?user.id=c3b5ba0287ca46e8bd5bf6ed186412e9&scope.project.id=34a7c8aba7114078a2c17c2635d4b753&role.id=f3311ba27a464113b884aa5a1144945d => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:32.923632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e783d1-81b9-4ebe-835a-991fef7a37ee None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:32.924224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e783d1-81b9-4ebe-835a-991fef7a37ee None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:32.924224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e783d1-81b9-4ebe-835a-991fef7a37ee None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:32.925980 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 583/1160] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:32.933127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b3fc0-00e5-4351-9f15-a9b51af507ba None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:32.933570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b3fc0-00e5-4351-9f15-a9b51af507ba None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:32.933693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b3fc0-00e5-4351-9f15-a9b51af507ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:32.956046 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-eb9b3fc0-00e5-4351-9f15-a9b51af507ba None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:32.957266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-eb9b3fc0-00e5-4351-9f15-a9b51af507ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:32.967798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 578/1161] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:32.993792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e783d1-81b9-4ebe-835a-991fef7a37ee None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:33.008984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e783d1-81b9-4ebe-835a-991fef7a37ee None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:33.014300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644279-fe41-48aa-8ec2-9c75b06a62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:33.014948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644279-fe41-48aa-8ec2-9c75b06a62ed admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:33.015228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644279-fe41-48aa-8ec2-9c75b06a62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:33.015497 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69644279-fe41-48aa-8ec2-9c75b06a62ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:33.023785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69644279-fe41-48aa-8ec2-9c75b06a62ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:33.025564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69644279-fe41-48aa-8ec2-9c75b06a62ed admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:33.034607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 584/1162] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:37:32 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:37:33.041908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b3fc0-00e5-4351-9f15-a9b51af507ba None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:33.051009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b3fc0-00e5-4351-9f15-a9b51af507ba None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:33.055833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6a0c6-f908-4a26-b87c-985a5962c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:33.056674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6a0c6-f908-4a26-b87c-985a5962c910 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:33.056958 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6a0c6-f908-4a26-b87c-985a5962c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:33.057237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6a0c6-f908-4a26-b87c-985a5962c910 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:33.064292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6a0c6-f908-4a26-b87c-985a5962c910 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:33.066159 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6a0c6-f908-4a26-b87c-985a5962c910 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:33.081080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-97b6a0c6-f908-4a26-b87c-985a5962c910 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Dec 13 16:37:33.082262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 579/1163] 10.222.0.62 () {56 vars in 1138 bytes} [Mon Dec 13 16:37:33 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:33.089353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644279-fe41-48aa-8ec2-9c75b06a62ed admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:33.098668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69644279-fe41-48aa-8ec2-9c75b06a62ed admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:33.103404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a143d6-5fa1-46e2-8bae-c875ecf7c91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:33.104064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a143d6-5fa1-46e2-8bae-c875ecf7c91f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:33.104351 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a143d6-5fa1-46e2-8bae-c875ecf7c91f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:33.104658 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a143d6-5fa1-46e2-8bae-c875ecf7c91f admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:33.105404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a143d6-5fa1-46e2-8bae-c875ecf7c91f admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:33.105713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a143d6-5fa1-46e2-8bae-c875ecf7c91f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:33.107309 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a143d6-5fa1-46e2-8bae-c875ecf7c91f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:33.115241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 585/1164] 10.222.0.62 () {56 vars in 1136 bytes} [Mon Dec 13 16:37:33 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:35.425889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e98a7-0c6c-4ae0-8c28-1adda1012781 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:35.426548 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e98a7-0c6c-4ae0-8c28-1adda1012781 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:35.426548 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e98a7-0c6c-4ae0-8c28-1adda1012781 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:35.428276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 580/1165] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:35.435235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fee55-f5a9-4ef9-99fa-e871919f6c15 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:35.435972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fee55-f5a9-4ef9-99fa-e871919f6c15 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:35.436130 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fee55-f5a9-4ef9-99fa-e871919f6c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:35.464400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a75fee55-f5a9-4ef9-99fa-e871919f6c15 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:35.465618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a75fee55-f5a9-4ef9-99fa-e871919f6c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:35.474436 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 586/1166] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:35.498231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e98a7-0c6c-4ae0-8c28-1adda1012781 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:35.511713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e98a7-0c6c-4ae0-8c28-1adda1012781 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:35.517382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16f0e9-83c3-443e-8760-cfe4f4200625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:35.518028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f0e9-83c3-443e-8760-cfe4f4200625 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:35.518309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f0e9-83c3-443e-8760-cfe4f4200625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:35.518580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f0e9-83c3-443e-8760-cfe4f4200625 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:35.519318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16f0e9-83c3-443e-8760-cfe4f4200625 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:35.520407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-ed16f0e9-83c3-443e-8760-cfe4f4200625 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:37:35.520407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:37:35.520407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:37:35.521322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16f0e9-83c3-443e-8760-cfe4f4200625 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:35.538515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 581/1167] 10.222.0.62 () {60 vars in 1159 bytes} [Mon Dec 13 16:37:35 2021] POST /identity/v3/domains => generated 267 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:37:37.875015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88083f8a-4685-4ee5-b580-04bed293e509 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:37.875584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88083f8a-4685-4ee5-b580-04bed293e509 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:37.875584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88083f8a-4685-4ee5-b580-04bed293e509 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:37.877358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 587/1168] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:37.884334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54238491-74f1-43ca-9d34-38267e3ab8ed None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:37.885072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54238491-74f1-43ca-9d34-38267e3ab8ed None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:37.885249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54238491-74f1-43ca-9d34-38267e3ab8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:37.907365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-54238491-74f1-43ca-9d34-38267e3ab8ed None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:37.908538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-54238491-74f1-43ca-9d34-38267e3ab8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:37.974966 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 582/1169] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:37.999932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88083f8a-4685-4ee5-b580-04bed293e509 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:38.019414 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88083f8a-4685-4ee5-b580-04bed293e509 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:38.027946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331bf66-0be8-472b-8436-470161c47a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:38.029344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331bf66-0be8-472b-8436-470161c47a98 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:38.029803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331bf66-0be8-472b-8436-470161c47a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:38.030266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331bf66-0be8-472b-8436-470161c47a98 admin admin] PATH_INFO: `/v3/domains/e9943615681146c38bd063fc830efa92` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:38.043555 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331bf66-0be8-472b-8436-470161c47a98 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=e9943615681146c38bd063fc830efa92)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:38.045568 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331bf66-0be8-472b-8436-470161c47a98 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:38.047188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 588/1170] 10.222.0.62 () {56 vars in 1204 bytes} [Mon Dec 13 16:37:37 2021] GET /identity/v3/domains/e9943615681146c38bd063fc830efa92 => generated 267 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:38.053585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54238491-74f1-43ca-9d34-38267e3ab8ed None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:38.062229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54238491-74f1-43ca-9d34-38267e3ab8ed None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:38.067576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebaa5e-6360-4be7-8ab5-44e3776482af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:38.068294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebaa5e-6360-4be7-8ab5-44e3776482af admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:38.068480 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebaa5e-6360-4be7-8ab5-44e3776482af admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:38.068809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebaa5e-6360-4be7-8ab5-44e3776482af admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:38.069534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebaa5e-6360-4be7-8ab5-44e3776482af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:38.071414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebaa5e-6360-4be7-8ab5-44e3776482af admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:38.102562 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 583/1171] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:37:38 2021] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:37:40.459849 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a58dc-c493-431f-94a6-65d68cc61673 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:40.460707 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a58dc-c493-431f-94a6-65d68cc61673 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:40.460707 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a58dc-c493-431f-94a6-65d68cc61673 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:40.463577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 589/1172] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:40.470491 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4db06-abbb-448d-8bc5-eea809c935fa None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:40.470960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4db06-abbb-448d-8bc5-eea809c935fa None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:40.471078 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4db06-abbb-448d-8bc5-eea809c935fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:40.490154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d1f4db06-abbb-448d-8bc5-eea809c935fa None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:40.491340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d1f4db06-abbb-448d-8bc5-eea809c935fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:40.552487 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 584/1173] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:40.590940 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a58dc-c493-431f-94a6-65d68cc61673 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:40.605235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a58dc-c493-431f-94a6-65d68cc61673 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:40.611025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af51be9-1b02-491c-b932-8a3ecdaae9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:40.611865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af51be9-1b02-491c-b932-8a3ecdaae9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:40.612137 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af51be9-1b02-491c-b932-8a3ecdaae9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:40.612403 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af51be9-1b02-491c-b932-8a3ecdaae9a6 admin admin] PATH_INFO: `/v3/domains/e9943615681146c38bd063fc830efa92` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:40.613777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af51be9-1b02-491c-b932-8a3ecdaae9a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=e9943615681146c38bd063fc830efa92)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:40.615864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af51be9-1b02-491c-b932-8a3ecdaae9a6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:40.617457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 590/1174] 10.222.0.62 () {56 vars in 1204 bytes} [Mon Dec 13 16:37:40 2021] GET /identity/v3/domains/e9943615681146c38bd063fc830efa92 => generated 267 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:40.624299 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4db06-abbb-448d-8bc5-eea809c935fa None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:40.639500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4db06-abbb-448d-8bc5-eea809c935fa None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:40.647606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8c1f4-1114-43a0-a8ef-d6616a79c754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:40.648263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8c1f4-1114-43a0-a8ef-d6616a79c754 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:40.648537 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8c1f4-1114-43a0-a8ef-d6616a79c754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:40.648832 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8c1f4-1114-43a0-a8ef-d6616a79c754 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:40.649521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8c1f4-1114-43a0-a8ef-d6616a79c754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:40.651403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8c1f4-1114-43a0-a8ef-d6616a79c754 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:40.674325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 585/1175] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:37:40 2021] POST /identity/v3/users => generated 311 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:37:43.099577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d4571-6ed5-4cd0-ab83-e6c86d753b79 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:43.100510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d4571-6ed5-4cd0-ab83-e6c86d753b79 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:43.100689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d4571-6ed5-4cd0-ab83-e6c86d753b79 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:43.103462 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 591/1176] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:43.110424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e344a-66e6-4901-95bb-0d31b5477bb8 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:43.111189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e344a-66e6-4901-95bb-0d31b5477bb8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:43.111294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e344a-66e6-4901-95bb-0d31b5477bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:43.131698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-e83e344a-66e6-4901-95bb-0d31b5477bb8 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:43.132924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e83e344a-66e6-4901-95bb-0d31b5477bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:43.142642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 586/1177] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:43.168818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d4571-6ed5-4cd0-ab83-e6c86d753b79 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:43.190511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d4571-6ed5-4cd0-ab83-e6c86d753b79 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:43.197038 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3f41b-bf89-40b0-b9cc-a84989e66c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:43.197823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3f41b-bf89-40b0-b9cc-a84989e66c84 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:43.198097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3f41b-bf89-40b0-b9cc-a84989e66c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:43.198360 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3f41b-bf89-40b0-b9cc-a84989e66c84 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:43.213142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3f41b-bf89-40b0-b9cc-a84989e66c84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:37:43.224000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-fba3f41b-bf89-40b0-b9cc-a84989e66c84 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:37:43.225183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 592/1178] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:37:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:43.231781 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e344a-66e6-4901-95bb-0d31b5477bb8 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:43.241407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e344a-66e6-4901-95bb-0d31b5477bb8 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:43.247900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1b8d-531c-408a-a4de-8a2569914c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:43.248558 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1b8d-531c-408a-a4de-8a2569914c08 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:43.248874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1b8d-531c-408a-a4de-8a2569914c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:43.249145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1b8d-531c-408a-a4de-8a2569914c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:43.249916 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1b8d-531c-408a-a4de-8a2569914c08 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:43.250220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1b8d-531c-408a-a4de-8a2569914c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:43.251829 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1b8d-531c-408a-a4de-8a2569914c08 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:43.261343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 587/1179] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:37:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:43.271423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3f41b-bf89-40b0-b9cc-a84989e66c84 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:43.286465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3f41b-bf89-40b0-b9cc-a84989e66c84 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:43.291757 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30956ec4-47cb-4c7f-beee-18f15e7c22de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:43.292599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30956ec4-47cb-4c7f-beee-18f15e7c22de admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:43.292907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30956ec4-47cb-4c7f-beee-18f15e7c22de admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:43.293176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30956ec4-47cb-4c7f-beee-18f15e7c22de admin admin] PATH_INFO: `/v3/users/8e5bca313d42482ba7003a9011e0e328` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:43.307608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30956ec4-47cb-4c7f-beee-18f15e7c22de admin admin] RBAC: Authorizing `identity:get_user(user_id=8e5bca313d42482ba7003a9011e0e328)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:43.309772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30956ec4-47cb-4c7f-beee-18f15e7c22de admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:43.311397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 593/1180] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:43 2021] GET /identity/v3/users/8e5bca313d42482ba7003a9011e0e328 => generated 311 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:43.318280 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1b8d-531c-408a-a4de-8a2569914c08 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:43.329180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1b8d-531c-408a-a4de-8a2569914c08 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:43.334502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac192877-95ad-494d-a073-c640b041ab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:43.335140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac192877-95ad-494d-a073-c640b041ab38 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:43.335414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac192877-95ad-494d-a073-c640b041ab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:43.335669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac192877-95ad-494d-a073-c640b041ab38 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:43.344174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac192877-95ad-494d-a073-c640b041ab38 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:43.345946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac192877-95ad-494d-a073-c640b041ab38 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:43.354956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 588/1181] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:37:43 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:37:43.361543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30956ec4-47cb-4c7f-beee-18f15e7c22de admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:43.371179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30956ec4-47cb-4c7f-beee-18f15e7c22de admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:43.376037 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac5eb1-3931-4989-871c-cc373cff5e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:43.376910 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5eb1-3931-4989-871c-cc373cff5e93 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:43.377183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5eb1-3931-4989-871c-cc373cff5e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:43.377454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac5eb1-3931-4989-871c-cc373cff5e93 admin admin] PATH_INFO: `/v3/projects/1c10f103b0094616a7b907fc9658f207` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:43.378672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac5eb1-3931-4989-871c-cc373cff5e93 admin admin] RBAC: Authorizing `identity:get_project(project_id=1c10f103b0094616a7b907fc9658f207)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:43.380786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac5eb1-3931-4989-871c-cc373cff5e93 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:43.382400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 594/1182] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:43 2021] GET /identity/v3/projects/1c10f103b0094616a7b907fc9658f207 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:43.389858 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac192877-95ad-494d-a073-c640b041ab38 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:43.404028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac192877-95ad-494d-a073-c640b041ab38 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:43.412291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8465e1-8488-4b53-b0fc-6b8544bad4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:43.412959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8465e1-8488-4b53-b0fc-6b8544bad4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:43.413237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8465e1-8488-4b53-b0fc-6b8544bad4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:43.413508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8465e1-8488-4b53-b0fc-6b8544bad4a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:43.414339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8465e1-8488-4b53-b0fc-6b8544bad4a5 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=1c10f103b0094616a7b907fc9658f207, user.id=8e5bca313d42482ba7003a9011e0e328) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:43.414647 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8465e1-8488-4b53-b0fc-6b8544bad4a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:43.416456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8465e1-8488-4b53-b0fc-6b8544bad4a5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:43.422229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 589/1183] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:37:43 2021] GET /identity/v3/role_assignments?user.id=8e5bca313d42482ba7003a9011e0e328&scope.project.id=1c10f103b0094616a7b907fc9658f207&role.id=f3311ba27a464113b884aa5a1144945d => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:45.733118 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae47a61-07c8-4a08-b892-ac827a7f4a54 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:45.733962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae47a61-07c8-4a08-b892-ac827a7f4a54 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:45.733962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae47a61-07c8-4a08-b892-ac827a7f4a54 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:45.736851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 595/1184] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:45 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:45.746963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a275f-a63e-48ea-8b55-577adef4c4c0 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:45.747372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a275f-a63e-48ea-8b55-577adef4c4c0 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:45.747558 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a275f-a63e-48ea-8b55-577adef4c4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:45.771745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-385a275f-a63e-48ea-8b55-577adef4c4c0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:45.772953 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-385a275f-a63e-48ea-8b55-577adef4c4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:45.782812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 590/1185] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:45.806127 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae47a61-07c8-4a08-b892-ac827a7f4a54 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:45.822192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae47a61-07c8-4a08-b892-ac827a7f4a54 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:45.827782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba4723-6e50-4553-ac67-d1e592037564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:45.828558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4723-6e50-4553-ac67-d1e592037564 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:45.828879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4723-6e50-4553-ac67-d1e592037564 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:45.829147 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba4723-6e50-4553-ac67-d1e592037564 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:45.840820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba4723-6e50-4553-ac67-d1e592037564 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:37:45.847459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-feba4723-6e50-4553-ac67-d1e592037564 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:37:45.848801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 596/1186] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:37:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:45.856145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a275f-a63e-48ea-8b55-577adef4c4c0 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:45.868507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a275f-a63e-48ea-8b55-577adef4c4c0 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:45.874313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f3189-3f61-4a97-b0fb-8a8d7c2fc69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:45.875057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f3189-3f61-4a97-b0fb-8a8d7c2fc69f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:45.875332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f3189-3f61-4a97-b0fb-8a8d7c2fc69f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:45.875676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f3189-3f61-4a97-b0fb-8a8d7c2fc69f admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:45.876441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f3189-3f61-4a97-b0fb-8a8d7c2fc69f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:45.876788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f3189-3f61-4a97-b0fb-8a8d7c2fc69f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:45.878387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f3189-3f61-4a97-b0fb-8a8d7c2fc69f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:45.887621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 591/1187] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:37:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:45.893836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba4723-6e50-4553-ac67-d1e592037564 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:45.904602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba4723-6e50-4553-ac67-d1e592037564 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:45.909580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c570fd-9805-4e38-8fd6-77594c5fce49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:45.910425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c570fd-9805-4e38-8fd6-77594c5fce49 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:45.910700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c570fd-9805-4e38-8fd6-77594c5fce49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:45.910970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c570fd-9805-4e38-8fd6-77594c5fce49 admin admin] PATH_INFO: `/v3/users/8e5bca313d42482ba7003a9011e0e328` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:45.912118 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c570fd-9805-4e38-8fd6-77594c5fce49 admin admin] RBAC: Authorizing `identity:get_user(user_id=8e5bca313d42482ba7003a9011e0e328)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:45.914234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c570fd-9805-4e38-8fd6-77594c5fce49 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:45.915798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 597/1188] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:45 2021] GET /identity/v3/users/8e5bca313d42482ba7003a9011e0e328 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:45.921704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f3189-3f61-4a97-b0fb-8a8d7c2fc69f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:45.931713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f3189-3f61-4a97-b0fb-8a8d7c2fc69f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:45.936388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149da34-7953-43af-b223-52964fc85d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:45.937243 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149da34-7953-43af-b223-52964fc85d49 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:45.937527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149da34-7953-43af-b223-52964fc85d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:45.937796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149da34-7953-43af-b223-52964fc85d49 admin admin] PATH_INFO: `/v3/projects/1c10f103b0094616a7b907fc9658f207` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:45.939011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149da34-7953-43af-b223-52964fc85d49 admin admin] RBAC: Authorizing `identity:get_project(project_id=1c10f103b0094616a7b907fc9658f207)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:45.941039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149da34-7953-43af-b223-52964fc85d49 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:45.943154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 592/1189] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:45 2021] GET /identity/v3/projects/1c10f103b0094616a7b907fc9658f207 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:37:45.948933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c570fd-9805-4e38-8fd6-77594c5fce49 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:45.958438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c570fd-9805-4e38-8fd6-77594c5fce49 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:45.963042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf47ab-41b7-40bf-b74d-ed82b48d8553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:45.963866 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf47ab-41b7-40bf-b74d-ed82b48d8553 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:45.964140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf47ab-41b7-40bf-b74d-ed82b48d8553 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:45.964406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf47ab-41b7-40bf-b74d-ed82b48d8553 admin admin] PATH_INFO: `/v3/projects/1c10f103b0094616a7b907fc9658f207/users/8e5bca313d42482ba7003a9011e0e328/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:45.966316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf47ab-41b7-40bf-b74d-ed82b48d8553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c10f103b0094616a7b907fc9658f207, user_id=8e5bca313d42482ba7003a9011e0e328, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:45.968898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf47ab-41b7-40bf-b74d-ed82b48d8553 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:45.983562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 598/1190] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:37:45 2021] PUT /identity/v3/projects/1c10f103b0094616a7b907fc9658f207/users/8e5bca313d42482ba7003a9011e0e328/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:37:48.283984 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fd4d6-e621-464c-ad0b-2267a92f9791 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:48.284601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fd4d6-e621-464c-ad0b-2267a92f9791 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:48.284601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fd4d6-e621-464c-ad0b-2267a92f9791 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:48.286407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 593/1191] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:37:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:37:48.293371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f9ab-69d7-4be9-beaf-f7368165a63b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:48.294057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f9ab-69d7-4be9-beaf-f7368165a63b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:48.294238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b213f9ab-69d7-4be9-beaf-f7368165a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:48.315520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b213f9ab-69d7-4be9-beaf-f7368165a63b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:37:48.316777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b213f9ab-69d7-4be9-beaf-f7368165a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:37:48.377957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 599/1192] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:37:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:37:48.403140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fd4d6-e621-464c-ad0b-2267a92f9791 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:48.417788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fd4d6-e621-464c-ad0b-2267a92f9791 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:48.423325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5e8c6-64a1-4c95-90f4-23bc5dbbbca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:48.424093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5e8c6-64a1-4c95-90f4-23bc5dbbbca5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:48.424371 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5e8c6-64a1-4c95-90f4-23bc5dbbbca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:48.424672 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5e8c6-64a1-4c95-90f4-23bc5dbbbca5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:48.436974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5e8c6-64a1-4c95-90f4-23bc5dbbbca5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:37:48.447345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-07f5e8c6-64a1-4c95-90f4-23bc5dbbbca5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:37:48.448536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 594/1193] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:37:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:37:48.455736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213f9ab-69d7-4be9-beaf-f7368165a63b None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:48.470054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b213f9ab-69d7-4be9-beaf-f7368165a63b None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:48.477402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fca0d-085f-4020-8d2c-0d221792e7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:48.478062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fca0d-085f-4020-8d2c-0d221792e7a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:48.478341 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fca0d-085f-4020-8d2c-0d221792e7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:48.478610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fca0d-085f-4020-8d2c-0d221792e7a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:48.479371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fca0d-085f-4020-8d2c-0d221792e7a7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:48.479674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fca0d-085f-4020-8d2c-0d221792e7a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:48.481310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fca0d-085f-4020-8d2c-0d221792e7a7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:48.491144 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 600/1194] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:37:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:48.498471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5e8c6-64a1-4c95-90f4-23bc5dbbbca5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:48.509709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5e8c6-64a1-4c95-90f4-23bc5dbbbca5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:48.515809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8520e8-3d34-43e8-bfe0-65db079d28bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:48.516672 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8520e8-3d34-43e8-bfe0-65db079d28bf admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:48.516952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8520e8-3d34-43e8-bfe0-65db079d28bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:48.517220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8520e8-3d34-43e8-bfe0-65db079d28bf admin admin] PATH_INFO: `/v3/users/8e5bca313d42482ba7003a9011e0e328` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:48.518558 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8520e8-3d34-43e8-bfe0-65db079d28bf admin admin] RBAC: Authorizing `identity:get_user(user_id=8e5bca313d42482ba7003a9011e0e328)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:48.521007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8520e8-3d34-43e8-bfe0-65db079d28bf admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:48.522591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 595/1195] 10.222.0.62 () {56 vars in 1198 bytes} [Mon Dec 13 16:37:48 2021] GET /identity/v3/users/8e5bca313d42482ba7003a9011e0e328 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:48.529325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fca0d-085f-4020-8d2c-0d221792e7a7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:48.542009 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fca0d-085f-4020-8d2c-0d221792e7a7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:48.547672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff87051-efc8-4ac2-a651-edbba3f1c3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:48.548296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff87051-efc8-4ac2-a651-edbba3f1c3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:48.548594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff87051-efc8-4ac2-a651-edbba3f1c3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:48.548867 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff87051-efc8-4ac2-a651-edbba3f1c3c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:48.556812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff87051-efc8-4ac2-a651-edbba3f1c3c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:48.558541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff87051-efc8-4ac2-a651-edbba3f1c3c1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:48.567730 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 601/1196] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:37:48 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:37:48.574097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8520e8-3d34-43e8-bfe0-65db079d28bf admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:48.584449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8520e8-3d34-43e8-bfe0-65db079d28bf admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:48.590197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab51067-abe2-4eb3-919a-6c0542e57aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:48.591020 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab51067-abe2-4eb3-919a-6c0542e57aaf admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:48.591291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab51067-abe2-4eb3-919a-6c0542e57aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:48.591561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab51067-abe2-4eb3-919a-6c0542e57aaf admin admin] PATH_INFO: `/v3/projects/1c10f103b0094616a7b907fc9658f207` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:48.592878 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab51067-abe2-4eb3-919a-6c0542e57aaf admin admin] RBAC: Authorizing `identity:get_project(project_id=1c10f103b0094616a7b907fc9658f207)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:48.594871 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab51067-abe2-4eb3-919a-6c0542e57aaf admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:48.596469 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 596/1197] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:37:48 2021] GET /identity/v3/projects/1c10f103b0094616a7b907fc9658f207 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:37:48.602793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff87051-efc8-4ac2-a651-edbba3f1c3c1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:37:48.611635 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff87051-efc8-4ac2-a651-edbba3f1c3c1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:37:48.617563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba94193-454d-4043-b817-ebd71532fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:37:48.618171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba94193-454d-4043-b817-ebd71532fad6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:37:48.618451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba94193-454d-4043-b817-ebd71532fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:37:48.618752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba94193-454d-4043-b817-ebd71532fad6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:37:48.619529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba94193-454d-4043-b817-ebd71532fad6 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=1c10f103b0094616a7b907fc9658f207, user.id=8e5bca313d42482ba7003a9011e0e328) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:37:48.619834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba94193-454d-4043-b817-ebd71532fad6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:37:48.621659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba94193-454d-4043-b817-ebd71532fad6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:37:48.627443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 602/1198] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:37:48 2021] GET /identity/v3/role_assignments?user.id=8e5bca313d42482ba7003a9011e0e328&scope.project.id=1c10f103b0094616a7b907fc9658f207&role.id=f3311ba27a464113b884aa5a1144945d => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:47.331434 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24816-14ff-4835-837a-e792545bfc99 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:47.332103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24816-14ff-4835-837a-e792545bfc99 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:47.332103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad24816-14ff-4835-837a-e792545bfc99 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:47.333856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 597/1199] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:38:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:38:47.343996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f4503-6080-4b93-b378-f9d976d955eb None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:47.343996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f4503-6080-4b93-b378-f9d976d955eb None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:47.343996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f4503-6080-4b93-b378-f9d976d955eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:47.365876 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-847f4503-6080-4b93-b378-f9d976d955eb None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:38:47.367234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-847f4503-6080-4b93-b378-f9d976d955eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:38:47.376021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 603/1200] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:38:47 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:38:47.404415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad24816-14ff-4835-837a-e792545bfc99 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:47.418138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad24816-14ff-4835-837a-e792545bfc99 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:47.423126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4993c-be3d-4bfa-8fa1-ddb204452e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:47.423981 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4993c-be3d-4bfa-8fa1-ddb204452e8c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:47.424267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4993c-be3d-4bfa-8fa1-ddb204452e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:47.424543 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4993c-be3d-4bfa-8fa1-ddb204452e8c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:47.435474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4993c-be3d-4bfa-8fa1-ddb204452e8c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:47.437348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4993c-be3d-4bfa-8fa1-ddb204452e8c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:47.454972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-e1c4993c-be3d-4bfa-8fa1-ddb204452e8c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:38:47.456535 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 598/1201] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:38:47.466906 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f4503-6080-4b93-b378-f9d976d955eb None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:47.476394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f4503-6080-4b93-b378-f9d976d955eb None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:47.481692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20844397-0c60-44c3-b433-8eb1e135ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:47.482355 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20844397-0c60-44c3-b433-8eb1e135ec35 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:47.482694 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20844397-0c60-44c3-b433-8eb1e135ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:47.482921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20844397-0c60-44c3-b433-8eb1e135ec35 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:47.483660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20844397-0c60-44c3-b433-8eb1e135ec35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:47.483974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20844397-0c60-44c3-b433-8eb1e135ec35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:47.485599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20844397-0c60-44c3-b433-8eb1e135ec35 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:47.499837 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 604/1202] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:38:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:38:47.506815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4993c-be3d-4bfa-8fa1-ddb204452e8c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:47.518565 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4993c-be3d-4bfa-8fa1-ddb204452e8c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:47.523667 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34f5a6-09fb-4cc5-a871-5fd2e149e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:47.524440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34f5a6-09fb-4cc5-a871-5fd2e149e2cc admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:47.524760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34f5a6-09fb-4cc5-a871-5fd2e149e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:47.525098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34f5a6-09fb-4cc5-a871-5fd2e149e2cc admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:47.525830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34f5a6-09fb-4cc5-a871-5fd2e149e2cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:47.527941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34f5a6-09fb-4cc5-a871-5fd2e149e2cc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:47.556795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 599/1203] 10.222.0.62 () {60 vars in 1153 bytes} [Mon Dec 13 16:38:47 2021] POST /identity/v3/users => generated 251 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:38:50.297244 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d724f-3e5d-4bb1-864c-79c162da6971 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.297848 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d724f-3e5d-4bb1-864c-79c162da6971 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.297848 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d724f-3e5d-4bb1-864c-79c162da6971 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.299633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 605/1204] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:38:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:38:50.306975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d61361-8668-499f-b305-98db4d02f632 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.308622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d61361-8668-499f-b305-98db4d02f632 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.308622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d61361-8668-499f-b305-98db4d02f632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.329216 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f9d61361-8668-499f-b305-98db4d02f632 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:38:50.331339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f9d61361-8668-499f-b305-98db4d02f632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:38:50.348600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 600/1205] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:38:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:38:50.370522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d724f-3e5d-4bb1-864c-79c162da6971 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.387800 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d724f-3e5d-4bb1-864c-79c162da6971 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.393272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03120fc-ec9d-41d7-a3c2-dee8720d3736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.394125 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03120fc-ec9d-41d7-a3c2-dee8720d3736 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.394397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03120fc-ec9d-41d7-a3c2-dee8720d3736 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.394703 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03120fc-ec9d-41d7-a3c2-dee8720d3736 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.406388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03120fc-ec9d-41d7-a3c2-dee8720d3736 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:38:50.413590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-d03120fc-ec9d-41d7-a3c2-dee8720d3736 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:38:50.414998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 606/1206] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:38:50.421616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d61361-8668-499f-b305-98db4d02f632 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.431415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d61361-8668-499f-b305-98db4d02f632 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.436067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18fd93-3bd1-4641-94d7-6670dc9b8170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.436774 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18fd93-3bd1-4641-94d7-6670dc9b8170 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.437043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18fd93-3bd1-4641-94d7-6670dc9b8170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.437312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18fd93-3bd1-4641-94d7-6670dc9b8170 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.438076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18fd93-3bd1-4641-94d7-6670dc9b8170 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:50.438382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18fd93-3bd1-4641-94d7-6670dc9b8170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:50.440689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18fd93-3bd1-4641-94d7-6670dc9b8170 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:50.451753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 601/1207] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:50.457875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03120fc-ec9d-41d7-a3c2-dee8720d3736 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.467693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03120fc-ec9d-41d7-a3c2-dee8720d3736 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.472808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111feaf-ec8e-4def-b4f0-86d2fec347df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.473612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111feaf-ec8e-4def-b4f0-86d2fec347df admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.473899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111feaf-ec8e-4def-b4f0-86d2fec347df admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.474176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111feaf-ec8e-4def-b4f0-86d2fec347df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.488635 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111feaf-ec8e-4def-b4f0-86d2fec347df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:50.489387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111feaf-ec8e-4def-b4f0-86d2fec347df admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:50.511208 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-f111feaf-ec8e-4def-b4f0-86d2fec347df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:38:50.512468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 607/1208] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:50.519207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18fd93-3bd1-4641-94d7-6670dc9b8170 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.530274 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18fd93-3bd1-4641-94d7-6670dc9b8170 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.536035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657d22-939e-440c-943b-f6e24db9abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.536817 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657d22-939e-440c-943b-f6e24db9abc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.537169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657d22-939e-440c-943b-f6e24db9abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.537505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf657d22-939e-440c-943b-f6e24db9abc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.538369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf657d22-939e-440c-943b-f6e24db9abc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:50.538709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf657d22-939e-440c-943b-f6e24db9abc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:50.540377 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf657d22-939e-440c-943b-f6e24db9abc0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:50.556964 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 602/1209] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:50.561849 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111feaf-ec8e-4def-b4f0-86d2fec347df admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.572548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111feaf-ec8e-4def-b4f0-86d2fec347df admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.578237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff8445-2c74-4bbb-b66b-e591eb7d5703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.579065 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff8445-2c74-4bbb-b66b-e591eb7d5703 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.579414 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff8445-2c74-4bbb-b66b-e591eb7d5703 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.579737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff8445-2c74-4bbb-b66b-e591eb7d5703 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.587629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff8445-2c74-4bbb-b66b-e591eb7d5703 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:50.589811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff8445-2c74-4bbb-b66b-e591eb7d5703 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:50.605453 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-efff8445-2c74-4bbb-b66b-e591eb7d5703 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 13 16:38:50.606838 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 608/1210] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/users/placement => generated 87 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:50.614401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657d22-939e-440c-943b-f6e24db9abc0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.624667 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf657d22-939e-440c-943b-f6e24db9abc0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.630164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64426baa-6b94-4899-bf4e-3860baa1dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.631034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64426baa-6b94-4899-bf4e-3860baa1dc23 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.631456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64426baa-6b94-4899-bf4e-3860baa1dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.631896 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64426baa-6b94-4899-bf4e-3860baa1dc23 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.632787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64426baa-6b94-4899-bf4e-3860baa1dc23 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:50.633096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64426baa-6b94-4899-bf4e-3860baa1dc23 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:50.635287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64426baa-6b94-4899-bf4e-3860baa1dc23 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:50.654105 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 603/1211] 10.222.0.62 () {56 vars in 1164 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:50.663283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff8445-2c74-4bbb-b66b-e591eb7d5703 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.671548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff8445-2c74-4bbb-b66b-e591eb7d5703 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.676971 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6a805-1eb0-430e-ab25-c4b14134b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.677617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a805-1eb0-430e-ab25-c4b14134b424 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.677898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a805-1eb0-430e-ab25-c4b14134b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.678184 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a805-1eb0-430e-ab25-c4b14134b424 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.686696 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6a805-1eb0-430e-ab25-c4b14134b424 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:50.688704 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6a805-1eb0-430e-ab25-c4b14134b424 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:50.699281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 609/1212] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:38:50.715359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64426baa-6b94-4899-bf4e-3860baa1dc23 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.726117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64426baa-6b94-4899-bf4e-3860baa1dc23 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.731245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db792b-6765-4e92-8f26-a0b481d7fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.732095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db792b-6765-4e92-8f26-a0b481d7fed4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.732377 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db792b-6765-4e92-8f26-a0b481d7fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.734131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db792b-6765-4e92-8f26-a0b481d7fed4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.744020 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db792b-6765-4e92-8f26-a0b481d7fed4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:50.745931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db792b-6765-4e92-8f26-a0b481d7fed4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:50.764916 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-47db792b-6765-4e92-8f26-a0b481d7fed4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:38:50.766478 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 604/1213] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:38:50.774467 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6a805-1eb0-430e-ab25-c4b14134b424 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.786535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6a805-1eb0-430e-ab25-c4b14134b424 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.791409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aece281-a693-4934-9585-73b394c2111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.792171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aece281-a693-4934-9585-73b394c2111f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.792767 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aece281-a693-4934-9585-73b394c2111f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.793089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aece281-a693-4934-9585-73b394c2111f admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.793827 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aece281-a693-4934-9585-73b394c2111f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:50.794105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aece281-a693-4934-9585-73b394c2111f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:50.795904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aece281-a693-4934-9585-73b394c2111f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:50.810422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 610/1214] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:50.817775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db792b-6765-4e92-8f26-a0b481d7fed4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.829649 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db792b-6765-4e92-8f26-a0b481d7fed4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.835906 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd285e-83bc-4b5f-842d-e24e73e63a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.836922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd285e-83bc-4b5f-842d-e24e73e63a45 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.837358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd285e-83bc-4b5f-842d-e24e73e63a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.837821 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd285e-83bc-4b5f-842d-e24e73e63a45 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.847115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd285e-83bc-4b5f-842d-e24e73e63a45 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:50.849089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd285e-83bc-4b5f-842d-e24e73e63a45 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:50.863300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-18fd285e-83bc-4b5f-842d-e24e73e63a45 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:38:50.864663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 605/1215] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:50.871521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aece281-a693-4934-9585-73b394c2111f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.882387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aece281-a693-4934-9585-73b394c2111f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.888039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e36aab-b516-4302-a964-8bff57df883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.891449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36aab-b516-4302-a964-8bff57df883c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.891449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36aab-b516-4302-a964-8bff57df883c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.891449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e36aab-b516-4302-a964-8bff57df883c admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.891449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e36aab-b516-4302-a964-8bff57df883c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:50.891449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e36aab-b516-4302-a964-8bff57df883c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:50.893618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e36aab-b516-4302-a964-8bff57df883c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:50.909381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 611/1216] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:38:50.916532 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd285e-83bc-4b5f-842d-e24e73e63a45 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:50.927730 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd285e-83bc-4b5f-842d-e24e73e63a45 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:50.932934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a775c0-7035-492e-ad0f-b7a8bcb528fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:50.933655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a775c0-7035-492e-ad0f-b7a8bcb528fd admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:50.933927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a775c0-7035-492e-ad0f-b7a8bcb528fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:50.935024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a775c0-7035-492e-ad0f-b7a8bcb528fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:50.935024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a775c0-7035-492e-ad0f-b7a8bcb528fd admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=02b7187c26dd41bea9f3c2b49de8ef28) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:50.935321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a775c0-7035-492e-ad0f-b7a8bcb528fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:50.937204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a775c0-7035-492e-ad0f-b7a8bcb528fd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:50.944166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 606/1217] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:38:50 2021] GET /identity/v3/role_assignments?user.id=02b7187c26dd41bea9f3c2b49de8ef28&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:38:53.477168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74ea24-06e2-4303-a003-4bddbcc9dfc9 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:53.477755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74ea24-06e2-4303-a003-4bddbcc9dfc9 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:53.477755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74ea24-06e2-4303-a003-4bddbcc9dfc9 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:53.479463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 612/1218] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:38:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:38:53.486054 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88430f39-30fd-4607-bff5-560c7b1cc341 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:53.486515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88430f39-30fd-4607-bff5-560c7b1cc341 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:53.486627 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88430f39-30fd-4607-bff5-560c7b1cc341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:53.513953 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-88430f39-30fd-4607-bff5-560c7b1cc341 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:38:53.516158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-88430f39-30fd-4607-bff5-560c7b1cc341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:38:53.527648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 607/1219] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:38:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:38:53.557732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74ea24-06e2-4303-a003-4bddbcc9dfc9 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:53.570886 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c74ea24-06e2-4303-a003-4bddbcc9dfc9 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:53.575432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42371-e855-41ea-babe-186150bf85b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:53.576166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42371-e855-41ea-babe-186150bf85b3 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:53.576511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42371-e855-41ea-babe-186150bf85b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:53.576818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42371-e855-41ea-babe-186150bf85b3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:53.587545 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42371-e855-41ea-babe-186150bf85b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:38:53.594511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-aee42371-e855-41ea-babe-186150bf85b3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:38:53.595726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 613/1220] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:38:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:53.602575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88430f39-30fd-4607-bff5-560c7b1cc341 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:53.612724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88430f39-30fd-4607-bff5-560c7b1cc341 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:53.617750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7767885-72a1-4c48-838e-676008f3d1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:53.618414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767885-72a1-4c48-838e-676008f3d1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:53.618690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767885-72a1-4c48-838e-676008f3d1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:53.618958 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7767885-72a1-4c48-838e-676008f3d1e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:53.619728 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7767885-72a1-4c48-838e-676008f3d1e4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:53.620055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7767885-72a1-4c48-838e-676008f3d1e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:53.621687 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7767885-72a1-4c48-838e-676008f3d1e4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:53.635130 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 608/1221] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:38:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:38:53.641624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42371-e855-41ea-babe-186150bf85b3 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:53.652156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42371-e855-41ea-babe-186150bf85b3 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:53.657842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b9931-121e-4774-a6e7-406b46281c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:53.658813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b9931-121e-4774-a6e7-406b46281c0a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:53.659136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b9931-121e-4774-a6e7-406b46281c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:53.659472 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b9931-121e-4774-a6e7-406b46281c0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:53.671190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b9931-121e-4774-a6e7-406b46281c0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:53.673069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b9931-121e-4774-a6e7-406b46281c0a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:53.691076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-0d3b9931-121e-4774-a6e7-406b46281c0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:38:53.692401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 614/1222] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:38:53.698991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7767885-72a1-4c48-838e-676008f3d1e4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:53.709694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7767885-72a1-4c48-838e-676008f3d1e4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:53.714238 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573283-4687-4cd4-b536-ca3d6829ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:53.714902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573283-4687-4cd4-b536-ca3d6829ab9c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:53.715187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573283-4687-4cd4-b536-ca3d6829ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:53.715471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573283-4687-4cd4-b536-ca3d6829ab9c admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:53.716207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2573283-4687-4cd4-b536-ca3d6829ab9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:53.716514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2573283-4687-4cd4-b536-ca3d6829ab9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:53.718164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2573283-4687-4cd4-b536-ca3d6829ab9c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:53.731161 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 609/1223] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:38:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:53.737779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b9931-121e-4774-a6e7-406b46281c0a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:53.748080 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b9931-121e-4774-a6e7-406b46281c0a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:53.754797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530a44d-d205-4dd2-b19c-8fb8cb45d597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:53.755600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530a44d-d205-4dd2-b19c-8fb8cb45d597 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:53.755878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530a44d-d205-4dd2-b19c-8fb8cb45d597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:53.756152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530a44d-d205-4dd2-b19c-8fb8cb45d597 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:53.766646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530a44d-d205-4dd2-b19c-8fb8cb45d597 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:53.769384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530a44d-d205-4dd2-b19c-8fb8cb45d597 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:53.786110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-0530a44d-d205-4dd2-b19c-8fb8cb45d597 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 13 16:38:53.787487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 615/1224] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:53 2021] GET /identity/v3/users/placement => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:38:53.794888 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573283-4687-4cd4-b536-ca3d6829ab9c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:53.806247 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573283-4687-4cd4-b536-ca3d6829ab9c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:53.812346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7e7fc-4193-44ae-adbb-67d200f0e189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:53.813044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7e7fc-4193-44ae-adbb-67d200f0e189 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:53.813323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7e7fc-4193-44ae-adbb-67d200f0e189 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:53.813680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7e7fc-4193-44ae-adbb-67d200f0e189 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:53.814834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7e7fc-4193-44ae-adbb-67d200f0e189 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:53.815148 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7e7fc-4193-44ae-adbb-67d200f0e189 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:53.817047 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7e7fc-4193-44ae-adbb-67d200f0e189 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:53.835571 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 610/1225] 10.222.0.62 () {56 vars in 1164 bytes} [Mon Dec 13 16:38:53 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:53.841810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530a44d-d205-4dd2-b19c-8fb8cb45d597 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:53.851738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530a44d-d205-4dd2-b19c-8fb8cb45d597 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:53.856812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac41cb2-7cc9-4803-a8a7-4f3b1752dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:53.857704 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac41cb2-7cc9-4803-a8a7-4f3b1752dc3a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:53.857985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac41cb2-7cc9-4803-a8a7-4f3b1752dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:53.858316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac41cb2-7cc9-4803-a8a7-4f3b1752dc3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:53.869899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac41cb2-7cc9-4803-a8a7-4f3b1752dc3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:53.871780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac41cb2-7cc9-4803-a8a7-4f3b1752dc3a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:53.889432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-dac41cb2-7cc9-4803-a8a7-4f3b1752dc3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:38:53.890617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 616/1226] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:53.897314 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7e7fc-4193-44ae-adbb-67d200f0e189 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:53.909344 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7e7fc-4193-44ae-adbb-67d200f0e189 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:53.913964 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18c57b-7d7a-4d3a-91b9-324acb3be466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:53.914620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18c57b-7d7a-4d3a-91b9-324acb3be466 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:53.914887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18c57b-7d7a-4d3a-91b9-324acb3be466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:53.915153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18c57b-7d7a-4d3a-91b9-324acb3be466 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:53.915891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18c57b-7d7a-4d3a-91b9-324acb3be466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:53.916189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18c57b-7d7a-4d3a-91b9-324acb3be466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:53.917830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18c57b-7d7a-4d3a-91b9-324acb3be466 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:53.930069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 611/1227] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:38:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:53.936439 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac41cb2-7cc9-4803-a8a7-4f3b1752dc3a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:53.946406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac41cb2-7cc9-4803-a8a7-4f3b1752dc3a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:53.950925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9b734-9ab9-4f37-86a5-7084b1739231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:53.951709 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9b734-9ab9-4f37-86a5-7084b1739231 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:53.951987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9b734-9ab9-4f37-86a5-7084b1739231 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:53.952256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9b734-9ab9-4f37-86a5-7084b1739231 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:53.959885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9b734-9ab9-4f37-86a5-7084b1739231 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:53.961964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9b734-9ab9-4f37-86a5-7084b1739231 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:53.977617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-03f9b734-9ab9-4f37-86a5-7084b1739231 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:38:53.979188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 617/1228] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:38:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:53.986116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18c57b-7d7a-4d3a-91b9-324acb3be466 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:53.996786 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18c57b-7d7a-4d3a-91b9-324acb3be466 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:54.002580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564aa5cf-db71-4a6c-a6b2-6b6a609a2cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:54.003257 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa5cf-db71-4a6c-a6b2-6b6a609a2cfe admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:54.003595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa5cf-db71-4a6c-a6b2-6b6a609a2cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:54.003902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564aa5cf-db71-4a6c-a6b2-6b6a609a2cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:54.004731 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aa5cf-db71-4a6c-a6b2-6b6a609a2cfe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:54.005040 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aa5cf-db71-4a6c-a6b2-6b6a609a2cfe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:54.006935 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564aa5cf-db71-4a6c-a6b2-6b6a609a2cfe admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:54.021143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 612/1229] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:38:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:54.029011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9b734-9ab9-4f37-86a5-7084b1739231 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:54.040259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9b734-9ab9-4f37-86a5-7084b1739231 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:54.045479 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d895ac3-ba0a-41f2-9d63-449b0e2530dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:54.046451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895ac3-ba0a-41f2-9d63-449b0e2530dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:54.046739 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895ac3-ba0a-41f2-9d63-449b0e2530dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:54.047014 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d895ac3-ba0a-41f2-9d63-449b0e2530dd admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/02b7187c26dd41bea9f3c2b49de8ef28/roles/0b0b2f3132974ff2a8a6fb9683036c6e` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:54.061805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d895ac3-ba0a-41f2-9d63-449b0e2530dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=02b7187c26dd41bea9f3c2b49de8ef28, role_id=0b0b2f3132974ff2a8a6fb9683036c6e)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:54.064683 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d895ac3-ba0a-41f2-9d63-449b0e2530dd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:54.079198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 618/1230] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:38:54 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/02b7187c26dd41bea9f3c2b49de8ef28/roles/0b0b2f3132974ff2a8a6fb9683036c6e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:38:56.575621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed8047-b743-4103-9126-96b8a2e43287 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:56.576171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed8047-b743-4103-9126-96b8a2e43287 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:56.576171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed8047-b743-4103-9126-96b8a2e43287 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:56.578063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 613/1231] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:38:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:38:56.584394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014c094-0454-4125-81c9-79c199e7298a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:56.584832 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014c094-0454-4125-81c9-79c199e7298a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:56.584971 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014c094-0454-4125-81c9-79c199e7298a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:56.605722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c014c094-0454-4125-81c9-79c199e7298a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:38:56.607486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c014c094-0454-4125-81c9-79c199e7298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:38:56.668158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 619/1232] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:38:56 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:38:56.697426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed8047-b743-4103-9126-96b8a2e43287 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:56.713108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed8047-b743-4103-9126-96b8a2e43287 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:56.718894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e2c3b-b167-4ed2-ba9b-9b4b3fc947db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:56.719861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e2c3b-b167-4ed2-ba9b-9b4b3fc947db admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:56.720140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e2c3b-b167-4ed2-ba9b-9b4b3fc947db admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:56.720525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e2c3b-b167-4ed2-ba9b-9b4b3fc947db admin admin] PATH_INFO: `/v3/roles/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:56.733485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e2c3b-b167-4ed2-ba9b-9b4b3fc947db admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:38:56.741692 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-197e2c3b-b167-4ed2-ba9b-9b4b3fc947db admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Dec 13 16:38:56.742923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 614/1233] 10.222.0.62 () {56 vars in 1123 bytes} [Mon Dec 13 16:38:56 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:56.750709 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014c094-0454-4125-81c9-79c199e7298a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:56.761452 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014c094-0454-4125-81c9-79c199e7298a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:56.767258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130dfb5-4b3f-4675-b189-c29b1a963fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:56.768003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130dfb5-4b3f-4675-b189-c29b1a963fbc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:56.768313 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130dfb5-4b3f-4675-b189-c29b1a963fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:56.768628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130dfb5-4b3f-4675-b189-c29b1a963fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:56.769399 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130dfb5-4b3f-4675-b189-c29b1a963fbc admin admin] RBAC: Adding query filter params (name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:56.769702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130dfb5-4b3f-4675-b189-c29b1a963fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:56.771465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130dfb5-4b3f-4675-b189-c29b1a963fbc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:56.780637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 620/1234] 10.222.0.62 () {56 vars in 1124 bytes} [Mon Dec 13 16:38:56 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:38:56.787372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e2c3b-b167-4ed2-ba9b-9b4b3fc947db admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:56.798080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e2c3b-b167-4ed2-ba9b-9b4b3fc947db admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:56.803631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292410a9-d556-4693-a84a-e5224c493716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:56.804414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292410a9-d556-4693-a84a-e5224c493716 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:56.804726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292410a9-d556-4693-a84a-e5224c493716 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:56.804998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292410a9-d556-4693-a84a-e5224c493716 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:56.815985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292410a9-d556-4693-a84a-e5224c493716 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:56.817850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292410a9-d556-4693-a84a-e5224c493716 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:56.834598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-292410a9-d556-4693-a84a-e5224c493716 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:38:56.836714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 615/1235] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:56.841979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130dfb5-4b3f-4675-b189-c29b1a963fbc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:56.852683 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130dfb5-4b3f-4675-b189-c29b1a963fbc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:56.858052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc5326-dcba-4ae1-8c8a-bde75a190f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:56.858806 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc5326-dcba-4ae1-8c8a-bde75a190f8d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:56.859083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc5326-dcba-4ae1-8c8a-bde75a190f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:56.859362 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc5326-dcba-4ae1-8c8a-bde75a190f8d admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:56.860135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc5326-dcba-4ae1-8c8a-bde75a190f8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:56.860451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc5326-dcba-4ae1-8c8a-bde75a190f8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:56.862363 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc5326-dcba-4ae1-8c8a-bde75a190f8d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:56.875145 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 621/1236] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:38:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:56.881582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292410a9-d556-4693-a84a-e5224c493716 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:56.891583 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292410a9-d556-4693-a84a-e5224c493716 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:56.896380 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d64f6-fd04-4893-a571-e8ef4e2e8ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:56.897187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d64f6-fd04-4893-a571-e8ef4e2e8ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:56.897464 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d64f6-fd04-4893-a571-e8ef4e2e8ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:56.897736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d64f6-fd04-4893-a571-e8ef4e2e8ff8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:56.905148 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d64f6-fd04-4893-a571-e8ef4e2e8ff8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:56.907163 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d64f6-fd04-4893-a571-e8ef4e2e8ff8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:56.921614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-f30d64f6-fd04-4893-a571-e8ef4e2e8ff8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 13 16:38:56.922793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 616/1237] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:56 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:56.929186 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc5326-dcba-4ae1-8c8a-bde75a190f8d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:56.939184 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc5326-dcba-4ae1-8c8a-bde75a190f8d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:56.944179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54939cc3-ed43-4548-8729-026ed2431c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:56.944852 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54939cc3-ed43-4548-8729-026ed2431c07 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:56.945129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54939cc3-ed43-4548-8729-026ed2431c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:56.945393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54939cc3-ed43-4548-8729-026ed2431c07 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:56.946415 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54939cc3-ed43-4548-8729-026ed2431c07 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:56.946686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54939cc3-ed43-4548-8729-026ed2431c07 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:56.948526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54939cc3-ed43-4548-8729-026ed2431c07 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:56.965567 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 622/1238] 10.222.0.62 () {56 vars in 1164 bytes} [Mon Dec 13 16:38:56 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:56.971913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d64f6-fd04-4893-a571-e8ef4e2e8ff8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:56.982767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d64f6-fd04-4893-a571-e8ef4e2e8ff8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:56.987531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e076214-4164-4dad-8f57-4a4ceaf71ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:56.988109 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e076214-4164-4dad-8f57-4a4ceaf71ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:56.988409 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e076214-4164-4dad-8f57-4a4ceaf71ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:56.988709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e076214-4164-4dad-8f57-4a4ceaf71ba7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:56.998321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e076214-4164-4dad-8f57-4a4ceaf71ba7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:57.001356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e076214-4164-4dad-8f57-4a4ceaf71ba7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:57.011642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 617/1239] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:38:56 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:38:57.018066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54939cc3-ed43-4548-8729-026ed2431c07 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:57.027685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54939cc3-ed43-4548-8729-026ed2431c07 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:57.032225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30756d1-ea9b-4a4d-80dd-f18fedca14f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:57.033314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30756d1-ea9b-4a4d-80dd-f18fedca14f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:57.033595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30756d1-ea9b-4a4d-80dd-f18fedca14f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:57.033860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30756d1-ea9b-4a4d-80dd-f18fedca14f5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:57.043898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30756d1-ea9b-4a4d-80dd-f18fedca14f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:57.045758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30756d1-ea9b-4a4d-80dd-f18fedca14f5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:57.062394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-c30756d1-ea9b-4a4d-80dd-f18fedca14f5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:38:57.063568 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 623/1240] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:57.070123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e076214-4164-4dad-8f57-4a4ceaf71ba7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:57.080192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e076214-4164-4dad-8f57-4a4ceaf71ba7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:57.085089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217c72c-49ef-4cc9-bbba-c27ea073bba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:57.085683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c72c-49ef-4cc9-bbba-c27ea073bba0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:57.085968 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c72c-49ef-4cc9-bbba-c27ea073bba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:57.086236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217c72c-49ef-4cc9-bbba-c27ea073bba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:57.086949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217c72c-49ef-4cc9-bbba-c27ea073bba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:57.087245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217c72c-49ef-4cc9-bbba-c27ea073bba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:57.088881 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217c72c-49ef-4cc9-bbba-c27ea073bba0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:57.100402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 618/1241] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:38:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:57.106599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30756d1-ea9b-4a4d-80dd-f18fedca14f5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:57.116361 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30756d1-ea9b-4a4d-80dd-f18fedca14f5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:57.121266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814ee04-12e6-4b7b-9667-c666ec9d7f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:57.122031 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ee04-12e6-4b7b-9667-c666ec9d7f1f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:57.122307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ee04-12e6-4b7b-9667-c666ec9d7f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:57.122581 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814ee04-12e6-4b7b-9667-c666ec9d7f1f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:57.129738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814ee04-12e6-4b7b-9667-c666ec9d7f1f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:57.131695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814ee04-12e6-4b7b-9667-c666ec9d7f1f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:57.144914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-a814ee04-12e6-4b7b-9667-c666ec9d7f1f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:38:57.146128 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 624/1242] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:38:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:57.152558 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217c72c-49ef-4cc9-bbba-c27ea073bba0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:57.162517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217c72c-49ef-4cc9-bbba-c27ea073bba0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:57.167109 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5befe32-cdee-43d5-b2cf-acfbaa2b9802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:57.167797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5befe32-cdee-43d5-b2cf-acfbaa2b9802 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:57.168013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5befe32-cdee-43d5-b2cf-acfbaa2b9802 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:57.168276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5befe32-cdee-43d5-b2cf-acfbaa2b9802 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:57.169103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5befe32-cdee-43d5-b2cf-acfbaa2b9802 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:57.169403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5befe32-cdee-43d5-b2cf-acfbaa2b9802 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:57.171246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5befe32-cdee-43d5-b2cf-acfbaa2b9802 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:57.184401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 619/1243] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:38:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:57.191035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814ee04-12e6-4b7b-9667-c666ec9d7f1f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:57.202152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814ee04-12e6-4b7b-9667-c666ec9d7f1f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:57.207262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44316761-5b1f-4ddb-80ee-b0f9493e1a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:57.207903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316761-5b1f-4ddb-80ee-b0f9493e1a2f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:57.208182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316761-5b1f-4ddb-80ee-b0f9493e1a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:57.208453 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44316761-5b1f-4ddb-80ee-b0f9493e1a2f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:57.209326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44316761-5b1f-4ddb-80ee-b0f9493e1a2f admin admin] RBAC: Adding query filter params (role.id=0b0b2f3132974ff2a8a6fb9683036c6e, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=02b7187c26dd41bea9f3c2b49de8ef28) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:57.209633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44316761-5b1f-4ddb-80ee-b0f9493e1a2f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:57.211494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44316761-5b1f-4ddb-80ee-b0f9493e1a2f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:57.218577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 625/1244] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:38:57 2021] GET /identity/v3/role_assignments?user.id=02b7187c26dd41bea9f3c2b49de8ef28&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=0b0b2f3132974ff2a8a6fb9683036c6e => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:59.719510 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed86b-0bf1-48ea-8065-82e3276566e4 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:59.720173 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed86b-0bf1-48ea-8065-82e3276566e4 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:59.721727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaed86b-0bf1-48ea-8065-82e3276566e4 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:59.723537 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 620/1245] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:38:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:38:59.729463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e2314-b987-4e47-8c78-945cdee18b71 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:59.729950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e2314-b987-4e47-8c78-945cdee18b71 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:59.730041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e2314-b987-4e47-8c78-945cdee18b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:59.747563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e99e2314-b987-4e47-8c78-945cdee18b71 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:38:59.748769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e99e2314-b987-4e47-8c78-945cdee18b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:38:59.756432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 626/1246] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:38:59 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:38:59.781557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaed86b-0bf1-48ea-8065-82e3276566e4 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:59.795355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaed86b-0bf1-48ea-8065-82e3276566e4 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:59.799734 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b364d0-506b-4f31-b569-95fe077c3c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:59.800511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b364d0-506b-4f31-b569-95fe077c3c3f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:59.800810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b364d0-506b-4f31-b569-95fe077c3c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:59.801086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b364d0-506b-4f31-b569-95fe077c3c3f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:59.812647 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b364d0-506b-4f31-b569-95fe077c3c3f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:38:59.819472 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a1b364d0-506b-4f31-b569-95fe077c3c3f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:38:59.820693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 621/1247] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:38:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:59.827245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e2314-b987-4e47-8c78-945cdee18b71 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:59.836048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e2314-b987-4e47-8c78-945cdee18b71 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:59.840532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e77cf-243f-471b-85a3-912c4e8154db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:59.841217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e77cf-243f-471b-85a3-912c4e8154db admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:59.841493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e77cf-243f-471b-85a3-912c4e8154db admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:59.841762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e77cf-243f-471b-85a3-912c4e8154db admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:59.842516 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e77cf-243f-471b-85a3-912c4e8154db admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:59.842813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e77cf-243f-471b-85a3-912c4e8154db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:59.844393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e77cf-243f-471b-85a3-912c4e8154db admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:59.853398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 627/1248] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:38:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:59.860202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b364d0-506b-4f31-b569-95fe077c3c3f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:59.872078 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b364d0-506b-4f31-b569-95fe077c3c3f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:59.878794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a3c9c-5167-4558-bd7b-53becdb81a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:59.879578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a3c9c-5167-4558-bd7b-53becdb81a49 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:59.879852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a3c9c-5167-4558-bd7b-53becdb81a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:59.880115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a3c9c-5167-4558-bd7b-53becdb81a49 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:59.891826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a3c9c-5167-4558-bd7b-53becdb81a49 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:59.893713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a3c9c-5167-4558-bd7b-53becdb81a49 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:59.912498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-ce5a3c9c-5167-4558-bd7b-53becdb81a49 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:38:59.914069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 622/1249] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:38:59.921122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e77cf-243f-471b-85a3-912c4e8154db admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:59.932167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e77cf-243f-471b-85a3-912c4e8154db admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:59.937391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173922b-3e3c-407d-8a42-89e9bc7fb98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:59.938273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173922b-3e3c-407d-8a42-89e9bc7fb98d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:59.938898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173922b-3e3c-407d-8a42-89e9bc7fb98d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:59.939265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173922b-3e3c-407d-8a42-89e9bc7fb98d admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:59.940325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173922b-3e3c-407d-8a42-89e9bc7fb98d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:38:59.940734 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173922b-3e3c-407d-8a42-89e9bc7fb98d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:59.943056 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173922b-3e3c-407d-8a42-89e9bc7fb98d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:38:59.957879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 628/1250] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:38:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:38:59.964224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a3c9c-5167-4558-bd7b-53becdb81a49 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:38:59.974859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a3c9c-5167-4558-bd7b-53becdb81a49 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:38:59.980191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e132665-6732-4fa0-b2b5-9a2b75cf1ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:38:59.981042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e132665-6732-4fa0-b2b5-9a2b75cf1ecd admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:38:59.981318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e132665-6732-4fa0-b2b5-9a2b75cf1ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:38:59.981584 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e132665-6732-4fa0-b2b5-9a2b75cf1ecd admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:38:59.991752 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e132665-6732-4fa0-b2b5-9a2b75cf1ecd admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:38:59.994229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e132665-6732-4fa0-b2b5-9a2b75cf1ecd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:00.009911 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-3e132665-6732-4fa0-b2b5-9a2b75cf1ecd admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 13 16:39:00.011169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 623/1251] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:38:59 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:00.017890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173922b-3e3c-407d-8a42-89e9bc7fb98d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:00.027685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173922b-3e3c-407d-8a42-89e9bc7fb98d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:00.032426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa945f-0efc-4994-b644-44654e27a2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:00.033113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa945f-0efc-4994-b644-44654e27a2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:00.033398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa945f-0efc-4994-b644-44654e27a2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:00.033662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa945f-0efc-4994-b644-44654e27a2b2 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:00.034500 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa945f-0efc-4994-b644-44654e27a2b2 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:00.034805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa945f-0efc-4994-b644-44654e27a2b2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:00.036672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa945f-0efc-4994-b644-44654e27a2b2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:00.054709 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 629/1252] 10.222.0.62 () {56 vars in 1164 bytes} [Mon Dec 13 16:39:00 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:39:00.061033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e132665-6732-4fa0-b2b5-9a2b75cf1ecd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:00.073042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e132665-6732-4fa0-b2b5-9a2b75cf1ecd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:00.078449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ca91-9696-41ac-9f1d-2974a365399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:00.079416 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ca91-9696-41ac-9f1d-2974a365399a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:00.079741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ca91-9696-41ac-9f1d-2974a365399a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:00.080260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ca91-9696-41ac-9f1d-2974a365399a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:00.088802 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440ca91-9696-41ac-9f1d-2974a365399a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:00.090951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440ca91-9696-41ac-9f1d-2974a365399a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:00.102058 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 624/1253] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:39:00 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:39:00.108438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa945f-0efc-4994-b644-44654e27a2b2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:00.119176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa945f-0efc-4994-b644-44654e27a2b2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:00.123752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa7361-2b32-4f3b-8244-9b1c08d76bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:00.124538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa7361-2b32-4f3b-8244-9b1c08d76bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:00.124846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa7361-2b32-4f3b-8244-9b1c08d76bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:00.125174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa7361-2b32-4f3b-8244-9b1c08d76bd4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:00.137379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa7361-2b32-4f3b-8244-9b1c08d76bd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:00.139283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa7361-2b32-4f3b-8244-9b1c08d76bd4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:00.156624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-86aa7361-2b32-4f3b-8244-9b1c08d76bd4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:39:00.158514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 630/1254] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:39:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:00.165126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ca91-9696-41ac-9f1d-2974a365399a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:00.174965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ca91-9696-41ac-9f1d-2974a365399a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:00.180527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea786ffd-876e-4a12-aa40-7d83615f73fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:00.181263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea786ffd-876e-4a12-aa40-7d83615f73fe admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:00.181614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea786ffd-876e-4a12-aa40-7d83615f73fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:00.181886 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea786ffd-876e-4a12-aa40-7d83615f73fe admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:00.182647 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea786ffd-876e-4a12-aa40-7d83615f73fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:00.182949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea786ffd-876e-4a12-aa40-7d83615f73fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:00.184532 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea786ffd-876e-4a12-aa40-7d83615f73fe admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:00.200106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 625/1255] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:39:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:00.207360 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa7361-2b32-4f3b-8244-9b1c08d76bd4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:00.218902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa7361-2b32-4f3b-8244-9b1c08d76bd4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:00.225476 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061dda5-333b-4061-a1a1-a8ae3d083eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:00.226190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061dda5-333b-4061-a1a1-a8ae3d083eaf admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:00.226467 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061dda5-333b-4061-a1a1-a8ae3d083eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:00.226737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061dda5-333b-4061-a1a1-a8ae3d083eaf admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:00.233981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061dda5-333b-4061-a1a1-a8ae3d083eaf admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:00.236417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061dda5-333b-4061-a1a1-a8ae3d083eaf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:00.249661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-2061dda5-333b-4061-a1a1-a8ae3d083eaf admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:39:00.250848 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 631/1256] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:39:00 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:39:00.257722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea786ffd-876e-4a12-aa40-7d83615f73fe admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:00.267983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea786ffd-876e-4a12-aa40-7d83615f73fe admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:00.273373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c365a87-31ca-4940-b517-d65eac10432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:00.274075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c365a87-31ca-4940-b517-d65eac10432b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:00.274309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c365a87-31ca-4940-b517-d65eac10432b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:00.274588 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c365a87-31ca-4940-b517-d65eac10432b admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:00.275380 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c365a87-31ca-4940-b517-d65eac10432b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:00.275666 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c365a87-31ca-4940-b517-d65eac10432b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:00.277534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c365a87-31ca-4940-b517-d65eac10432b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:00.295348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 626/1257] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:39:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:39:00.296681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061dda5-333b-4061-a1a1-a8ae3d083eaf admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:00.307337 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061dda5-333b-4061-a1a1-a8ae3d083eaf admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:00.312029 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef416b-3de0-444b-a418-c7910be87530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:00.312683 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef416b-3de0-444b-a418-c7910be87530 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:00.312948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef416b-3de0-444b-a418-c7910be87530 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:00.313213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef416b-3de0-444b-a418-c7910be87530 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:00.314029 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef416b-3de0-444b-a418-c7910be87530 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=02b7187c26dd41bea9f3c2b49de8ef28) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:00.314400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef416b-3de0-444b-a418-c7910be87530 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:00.316189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef416b-3de0-444b-a418-c7910be87530 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:00.323062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 632/1258] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:39:00 2021] GET /identity/v3/role_assignments?user.id=02b7187c26dd41bea9f3c2b49de8ef28&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=f3311ba27a464113b884aa5a1144945d => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:03.012334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d91bd-2d8e-45c3-a215-a5488e8805e0 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.013026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d91bd-2d8e-45c3-a215-a5488e8805e0 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.013110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d91bd-2d8e-45c3-a215-a5488e8805e0 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.015466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 627/1259] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:39:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:39:03.022479 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa8c2d-c71b-4554-9fc5-5daa1f71f96a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.022905 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa8c2d-c71b-4554-9fc5-5daa1f71f96a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.023175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa8c2d-c71b-4554-9fc5-5daa1f71f96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.042535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-d7aa8c2d-c71b-4554-9fc5-5daa1f71f96a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:39:03.043947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d7aa8c2d-c71b-4554-9fc5-5daa1f71f96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:39:03.053280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 633/1260] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:39:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:39:03.081082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d91bd-2d8e-45c3-a215-a5488e8805e0 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:03.094827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d91bd-2d8e-45c3-a215-a5488e8805e0 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:03.099769 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7341f9c-1007-49f5-b221-cbd66a1755fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:03.100563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7341f9c-1007-49f5-b221-cbd66a1755fb admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.100876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7341f9c-1007-49f5-b221-cbd66a1755fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.101153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7341f9c-1007-49f5-b221-cbd66a1755fb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.112517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7341f9c-1007-49f5-b221-cbd66a1755fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:39:03.120120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a7341f9c-1007-49f5-b221-cbd66a1755fb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:39:03.121358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 628/1261] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:39:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:03.128144 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa8c2d-c71b-4554-9fc5-5daa1f71f96a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:03.137783 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa8c2d-c71b-4554-9fc5-5daa1f71f96a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:03.142883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b012795-3a73-4cd2-b287-70a4022540e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:03.143553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b012795-3a73-4cd2-b287-70a4022540e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.143831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b012795-3a73-4cd2-b287-70a4022540e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.144089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b012795-3a73-4cd2-b287-70a4022540e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.144881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b012795-3a73-4cd2-b287-70a4022540e7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:03.145177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b012795-3a73-4cd2-b287-70a4022540e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:03.146771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b012795-3a73-4cd2-b287-70a4022540e7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:03.155629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 634/1262] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:39:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:03.161956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7341f9c-1007-49f5-b221-cbd66a1755fb admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:03.172940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7341f9c-1007-49f5-b221-cbd66a1755fb admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:03.178557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e85e2-394b-4c10-8730-9cc8763494c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:03.179304 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e85e2-394b-4c10-8730-9cc8763494c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.179584 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e85e2-394b-4c10-8730-9cc8763494c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.179848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e85e2-394b-4c10-8730-9cc8763494c7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.191992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e85e2-394b-4c10-8730-9cc8763494c7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:03.194224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e85e2-394b-4c10-8730-9cc8763494c7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:03.211814 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-c55e85e2-394b-4c10-8730-9cc8763494c7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:39:03.216731 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 629/1263] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:39:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:03.219493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b012795-3a73-4cd2-b287-70a4022540e7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:03.229536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b012795-3a73-4cd2-b287-70a4022540e7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:03.234042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba72035-3b98-4064-b46d-99cf8dde0b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:03.234685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72035-3b98-4064-b46d-99cf8dde0b96 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.234963 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72035-3b98-4064-b46d-99cf8dde0b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.235231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba72035-3b98-4064-b46d-99cf8dde0b96 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.235998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba72035-3b98-4064-b46d-99cf8dde0b96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:03.236296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba72035-3b98-4064-b46d-99cf8dde0b96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:03.237923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba72035-3b98-4064-b46d-99cf8dde0b96 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:03.249581 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 635/1264] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:39:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:03.256455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e85e2-394b-4c10-8730-9cc8763494c7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:03.268706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e85e2-394b-4c10-8730-9cc8763494c7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:03.273996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d890a-09ec-4207-816d-b330154f673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:03.274786 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d890a-09ec-4207-816d-b330154f673d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.275060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d890a-09ec-4207-816d-b330154f673d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.275325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d890a-09ec-4207-816d-b330154f673d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.283039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d890a-09ec-4207-816d-b330154f673d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:03.285082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d890a-09ec-4207-816d-b330154f673d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:03.299104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a26d890a-09ec-4207-816d-b330154f673d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 13 16:39:03.300252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 630/1265] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:39:03 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:03.306786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba72035-3b98-4064-b46d-99cf8dde0b96 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:03.317442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba72035-3b98-4064-b46d-99cf8dde0b96 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:03.322690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a7d0b-fcc1-499d-8ef0-c526c4c1ec9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:03.323428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a7d0b-fcc1-499d-8ef0-c526c4c1ec9b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.323691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a7d0b-fcc1-499d-8ef0-c526c4c1ec9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.323934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a7d0b-fcc1-499d-8ef0-c526c4c1ec9b admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.324829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a7d0b-fcc1-499d-8ef0-c526c4c1ec9b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:03.325117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a7d0b-fcc1-499d-8ef0-c526c4c1ec9b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:03.326956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a7d0b-fcc1-499d-8ef0-c526c4c1ec9b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:03.347303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 636/1266] 10.222.0.62 () {56 vars in 1164 bytes} [Mon Dec 13 16:39:03 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:03.355082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d890a-09ec-4207-816d-b330154f673d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:03.366623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d890a-09ec-4207-816d-b330154f673d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:03.372121 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2992933-2eb0-43a7-ba17-0b48f03564ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:03.372920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2992933-2eb0-43a7-ba17-0b48f03564ec admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.373200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2992933-2eb0-43a7-ba17-0b48f03564ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.373468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2992933-2eb0-43a7-ba17-0b48f03564ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.384795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2992933-2eb0-43a7-ba17-0b48f03564ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:03.386743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2992933-2eb0-43a7-ba17-0b48f03564ec admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:03.404278 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-b2992933-2eb0-43a7-ba17-0b48f03564ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:39:03.405598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 631/1267] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:39:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:03.412379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a7d0b-fcc1-499d-8ef0-c526c4c1ec9b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:03.423171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a7d0b-fcc1-499d-8ef0-c526c4c1ec9b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:03.428042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b03e9-6c6a-434f-9288-8713a2657cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:03.428762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b03e9-6c6a-434f-9288-8713a2657cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.429039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b03e9-6c6a-434f-9288-8713a2657cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.429310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b03e9-6c6a-434f-9288-8713a2657cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.430173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b03e9-6c6a-434f-9288-8713a2657cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:03.430475 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b03e9-6c6a-434f-9288-8713a2657cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:03.432304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b03e9-6c6a-434f-9288-8713a2657cf1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:03.445102 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 637/1268] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:39:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:03.451426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2992933-2eb0-43a7-ba17-0b48f03564ec admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:03.462819 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2992933-2eb0-43a7-ba17-0b48f03564ec admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:03.468138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e065d-e42a-4c8b-b5b5-6c28efa6089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:03.469153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e065d-e42a-4c8b-b5b5-6c28efa6089f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.469431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e065d-e42a-4c8b-b5b5-6c28efa6089f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.469890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e065d-e42a-4c8b-b5b5-6c28efa6089f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.478382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e065d-e42a-4c8b-b5b5-6c28efa6089f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:03.480689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e065d-e42a-4c8b-b5b5-6c28efa6089f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:03.497883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-a91e065d-e42a-4c8b-b5b5-6c28efa6089f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:39:03.499281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 632/1269] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:39:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Dec 13 16:39:03.509032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b03e9-6c6a-434f-9288-8713a2657cf1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:03.519707 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b03e9-6c6a-434f-9288-8713a2657cf1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:03.525092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42abac4-2267-467f-a9de-fb195225cf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:03.525747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42abac4-2267-467f-a9de-fb195225cf10 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.526022 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42abac4-2267-467f-a9de-fb195225cf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.526295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42abac4-2267-467f-a9de-fb195225cf10 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.527088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42abac4-2267-467f-a9de-fb195225cf10 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:03.527387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42abac4-2267-467f-a9de-fb195225cf10 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:03.529258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42abac4-2267-467f-a9de-fb195225cf10 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:03.544558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 638/1270] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:39:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:03.552067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e065d-e42a-4c8b-b5b5-6c28efa6089f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:03.564118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e065d-e42a-4c8b-b5b5-6c28efa6089f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:03.568935 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57bbda5-c668-4c5e-90c5-992e8248194c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:03.569829 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bbda5-c668-4c5e-90c5-992e8248194c admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:03.570197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bbda5-c668-4c5e-90c5-992e8248194c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:03.570444 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57bbda5-c668-4c5e-90c5-992e8248194c admin admin] PATH_INFO: `/v3/projects/d90ec194868c40c7909631544fecc3e8/users/02b7187c26dd41bea9f3c2b49de8ef28/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:03.572467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bbda5-c668-4c5e-90c5-992e8248194c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90ec194868c40c7909631544fecc3e8, user_id=02b7187c26dd41bea9f3c2b49de8ef28, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:03.575275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57bbda5-c668-4c5e-90c5-992e8248194c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:03.591003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 633/1271] 10.222.0.62 () {58 vars in 1460 bytes} [Mon Dec 13 16:39:03 2021] PUT /identity/v3/projects/d90ec194868c40c7909631544fecc3e8/users/02b7187c26dd41bea9f3c2b49de8ef28/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:39:06.163782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65e4c-d6b0-4295-b576-e204e4b8944a None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.164340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65e4c-d6b0-4295-b576-e204e4b8944a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.164340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e65e4c-d6b0-4295-b576-e204e4b8944a None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.166165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 639/1272] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:39:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:39:06.172431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2172c-1b4b-42fc-b701-e13859427a53 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.173021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2172c-1b4b-42fc-b701-e13859427a53 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.173701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2172c-1b4b-42fc-b701-e13859427a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.193138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-9dc2172c-1b4b-42fc-b701-e13859427a53 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:39:06.194320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9dc2172c-1b4b-42fc-b701-e13859427a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:39:06.254357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 634/1273] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:39:06 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:39:06.279488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e65e4c-d6b0-4295-b576-e204e4b8944a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.293627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e65e4c-d6b0-4295-b576-e204e4b8944a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.299167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b42fc-1c17-4582-b70e-01200574dfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.299934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b42fc-1c17-4582-b70e-01200574dfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.300205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b42fc-1c17-4582-b70e-01200574dfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.300465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85b42fc-1c17-4582-b70e-01200574dfb2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.311016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85b42fc-1c17-4582-b70e-01200574dfb2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Dec 13 16:39:06.317746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-d85b42fc-1c17-4582-b70e-01200574dfb2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Dec 13 16:39:06.318878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 640/1274] 10.222.0.62 () {56 vars in 1117 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:06.325641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2172c-1b4b-42fc-b701-e13859427a53 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.335283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc2172c-1b4b-42fc-b701-e13859427a53 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.341144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf68f4-e4cb-4f33-aead-03a49b867089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.341806 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf68f4-e4cb-4f33-aead-03a49b867089 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.342078 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf68f4-e4cb-4f33-aead-03a49b867089 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.342343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf68f4-e4cb-4f33-aead-03a49b867089 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.343106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf68f4-e4cb-4f33-aead-03a49b867089 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:06.343404 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf68f4-e4cb-4f33-aead-03a49b867089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:06.345090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf68f4-e4cb-4f33-aead-03a49b867089 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:06.354726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 635/1275] 10.222.0.62 () {56 vars in 1120 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:06.361096 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b42fc-1c17-4582-b70e-01200574dfb2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.371103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85b42fc-1c17-4582-b70e-01200574dfb2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.376131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c9bd-3063-4165-b7d4-f491fdeb3237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.376798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c9bd-3063-4165-b7d4-f491fdeb3237 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.377076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c9bd-3063-4165-b7d4-f491fdeb3237 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.377339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0c9bd-3063-4165-b7d4-f491fdeb3237 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.388300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c9bd-3063-4165-b7d4-f491fdeb3237 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:06.390149 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa0c9bd-3063-4165-b7d4-f491fdeb3237 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:06.408026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-bfa0c9bd-3063-4165-b7d4-f491fdeb3237 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:39:06.408359 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 641/1276] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:06.416484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf68f4-e4cb-4f33-aead-03a49b867089 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.432807 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf68f4-e4cb-4f33-aead-03a49b867089 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.441292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92aa521-aabf-4ffc-acc6-09bd2abf964c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.441947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aa521-aabf-4ffc-acc6-09bd2abf964c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.442230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aa521-aabf-4ffc-acc6-09bd2abf964c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.442501 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aa521-aabf-4ffc-acc6-09bd2abf964c admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.443244 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92aa521-aabf-4ffc-acc6-09bd2abf964c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:06.443550 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92aa521-aabf-4ffc-acc6-09bd2abf964c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:06.445185 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92aa521-aabf-4ffc-acc6-09bd2abf964c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:06.458354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 636/1277] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:06.464718 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c9bd-3063-4165-b7d4-f491fdeb3237 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.475086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0c9bd-3063-4165-b7d4-f491fdeb3237 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.480550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658445d-4151-42c4-8b81-737f5030a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.481357 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658445d-4151-42c4-8b81-737f5030a5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.481641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658445d-4151-42c4-8b81-737f5030a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.481915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658445d-4151-42c4-8b81-737f5030a5c2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.490285 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658445d-4151-42c4-8b81-737f5030a5c2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:06.492360 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658445d-4151-42c4-8b81-737f5030a5c2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:06.507978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-a658445d-4151-42c4-8b81-737f5030a5c2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Dec 13 16:39:06.509758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 642/1278] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:06.516690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92aa521-aabf-4ffc-acc6-09bd2abf964c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.529580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92aa521-aabf-4ffc-acc6-09bd2abf964c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.536247 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15169138-65cc-4251-949c-522294b5b6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.536946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15169138-65cc-4251-949c-522294b5b6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.537304 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15169138-65cc-4251-949c-522294b5b6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.537583 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15169138-65cc-4251-949c-522294b5b6e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.538548 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15169138-65cc-4251-949c-522294b5b6e5 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:06.538850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15169138-65cc-4251-949c-522294b5b6e5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:06.541079 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15169138-65cc-4251-949c-522294b5b6e5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:06.561430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 637/1279] 10.222.0.62 () {56 vars in 1164 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:06.569603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658445d-4151-42c4-8b81-737f5030a5c2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.580188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658445d-4151-42c4-8b81-737f5030a5c2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.586710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382c8f-c748-4db9-8e64-04741005d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.587342 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382c8f-c748-4db9-8e64-04741005d827 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.587615 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382c8f-c748-4db9-8e64-04741005d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.587878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b382c8f-c748-4db9-8e64-04741005d827 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.596334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382c8f-c748-4db9-8e64-04741005d827 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:06.598112 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b382c8f-c748-4db9-8e64-04741005d827 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:06.606818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 643/1280] 10.222.0.62 () {58 vars in 1324 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:39:06.613275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15169138-65cc-4251-949c-522294b5b6e5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.623468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15169138-65cc-4251-949c-522294b5b6e5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.629941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c93dc-c83c-4e51-87c4-12b285e112fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.630725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c93dc-c83c-4e51-87c4-12b285e112fc admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.631007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c93dc-c83c-4e51-87c4-12b285e112fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.631277 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c93dc-c83c-4e51-87c4-12b285e112fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.643759 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c93dc-c83c-4e51-87c4-12b285e112fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:06.645631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c93dc-c83c-4e51-87c4-12b285e112fc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:06.663922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-258c93dc-c83c-4e51-87c4-12b285e112fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Dec 13 16:39:06.665076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 638/1281] 10.222.0.62 () {56 vars in 1129 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:06.674395 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382c8f-c748-4db9-8e64-04741005d827 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.688383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b382c8f-c748-4db9-8e64-04741005d827 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.694970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a439c-7b3d-4a7f-a80e-f8c60a374114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.695606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a439c-7b3d-4a7f-a80e-f8c60a374114 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.695883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a439c-7b3d-4a7f-a80e-f8c60a374114 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.696145 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a439c-7b3d-4a7f-a80e-f8c60a374114 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.696901 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a439c-7b3d-4a7f-a80e-f8c60a374114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:06.697201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a439c-7b3d-4a7f-a80e-f8c60a374114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:06.698741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a439c-7b3d-4a7f-a80e-f8c60a374114 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:06.710190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 644/1282] 10.222.0.62 () {56 vars in 1130 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:06.716639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c93dc-c83c-4e51-87c4-12b285e112fc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.729088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c93dc-c83c-4e51-87c4-12b285e112fc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.734715 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d830f-1a0d-431c-9fdd-2d4d0e57ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.736026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d830f-1a0d-431c-9fdd-2d4d0e57ce85 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.736303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d830f-1a0d-431c-9fdd-2d4d0e57ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.736606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d830f-1a0d-431c-9fdd-2d4d0e57ce85 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.743764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d830f-1a0d-431c-9fdd-2d4d0e57ce85 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:06.745735 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d830f-1a0d-431c-9fdd-2d4d0e57ce85 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:06.759628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING keystone.server.flask.application [None req-ee0d830f-1a0d-431c-9fdd-2d4d0e57ce85 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Dec 13 16:39:06.760749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 639/1283] 10.222.0.62 () {56 vars in 1132 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:06.769115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a439c-7b3d-4a7f-a80e-f8c60a374114 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.779805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a439c-7b3d-4a7f-a80e-f8c60a374114 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.786389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe51329-7a5e-4fe5-9287-b12a08713358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.787016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51329-7a5e-4fe5-9287-b12a08713358 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.787291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51329-7a5e-4fe5-9287-b12a08713358 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.787554 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe51329-7a5e-4fe5-9287-b12a08713358 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.788334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe51329-7a5e-4fe5-9287-b12a08713358 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:06.788658 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe51329-7a5e-4fe5-9287-b12a08713358 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:06.790458 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe51329-7a5e-4fe5-9287-b12a08713358 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:06.803548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 645/1284] 10.222.0.62 () {56 vars in 1169 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:06.810199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d830f-1a0d-431c-9fdd-2d4d0e57ce85 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:06.827594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d830f-1a0d-431c-9fdd-2d4d0e57ce85 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:06.835037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0017fc-cfed-41ee-8d19-c973024152e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:06.835665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0017fc-cfed-41ee-8d19-c973024152e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:06.835940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0017fc-cfed-41ee-8d19-c973024152e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:06.836208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0017fc-cfed-41ee-8d19-c973024152e5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:06.837084 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0017fc-cfed-41ee-8d19-c973024152e5 admin admin] RBAC: Adding query filter params (role.id=f3311ba27a464113b884aa5a1144945d, scope.project.id=d90ec194868c40c7909631544fecc3e8, user.id=02b7187c26dd41bea9f3c2b49de8ef28) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:06.837377 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0017fc-cfed-41ee-8d19-c973024152e5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:06.839193 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0017fc-cfed-41ee-8d19-c973024152e5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:06.846126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 640/1285] 10.222.0.62 () {56 vars in 1395 bytes} [Mon Dec 13 16:39:06 2021] GET /identity/v3/role_assignments?user.id=02b7187c26dd41bea9f3c2b49de8ef28&scope.project.id=d90ec194868c40c7909631544fecc3e8&role.id=f3311ba27a464113b884aa5a1144945d => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:09.208228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae1b5b-3fe1-431b-ab35-4a41bd9dbb90 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:09.208815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae1b5b-3fe1-431b-ab35-4a41bd9dbb90 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:09.208815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae1b5b-3fe1-431b-ab35-4a41bd9dbb90 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:09.211584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 646/1286] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:39:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:39:09.221483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9df24-df07-4aa9-9692-28cbcbde763e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:09.221887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9df24-df07-4aa9-9692-28cbcbde763e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:09.222061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9df24-df07-4aa9-9692-28cbcbde763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:09.245593 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-12e9df24-df07-4aa9-9692-28cbcbde763e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:39:09.246773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-12e9df24-df07-4aa9-9692-28cbcbde763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:39:09.255607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 641/1287] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:39:09 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:39:09.279409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae1b5b-3fe1-431b-ab35-4a41bd9dbb90 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:09.300729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae1b5b-3fe1-431b-ab35-4a41bd9dbb90 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:09.307020 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb22688-5b19-4f6a-8e43-bc670d9895e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:09.307799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22688-5b19-4f6a-8e43-bc670d9895e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:09.308076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22688-5b19-4f6a-8e43-bc670d9895e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:09.308340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22688-5b19-4f6a-8e43-bc670d9895e5 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:09.309042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb22688-5b19-4f6a-8e43-bc670d9895e5 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:09.310649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb22688-5b19-4f6a-8e43-bc670d9895e5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:09.322938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-5fb22688-5b19-4f6a-8e43-bc670d9895e5 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 13 16:39:09.324104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 647/1288] 10.222.0.62 () {56 vars in 1138 bytes} [Mon Dec 13 16:39:09 2021] GET /identity/v3/services/placement => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:09.331220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9df24-df07-4aa9-9692-28cbcbde763e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:09.340536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9df24-df07-4aa9-9692-28cbcbde763e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:09.346350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45734a97-0861-440a-aeeb-4ca1e9acc4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:09.347003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734a97-0861-440a-aeeb-4ca1e9acc4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:09.347277 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734a97-0861-440a-aeeb-4ca1e9acc4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:09.347540 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45734a97-0861-440a-aeeb-4ca1e9acc4f4 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:09.348252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45734a97-0861-440a-aeeb-4ca1e9acc4f4 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:09.348549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45734a97-0861-440a-aeeb-4ca1e9acc4f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:09.350170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45734a97-0861-440a-aeeb-4ca1e9acc4f4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:09.355378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 642/1289] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Dec 13 16:39:09 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:09.361489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb22688-5b19-4f6a-8e43-bc670d9895e5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:09.371179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb22688-5b19-4f6a-8e43-bc670d9895e5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:09.376419 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa465b-d8d5-4102-b0a6-f3e4b7918a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:09.377075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa465b-d8d5-4102-b0a6-f3e4b7918a0f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:09.377353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa465b-d8d5-4102-b0a6-f3e4b7918a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:09.377646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa465b-d8d5-4102-b0a6-f3e4b7918a0f admin admin] PATH_INFO: `/v3/services` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:09.379219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa465b-d8d5-4102-b0a6-f3e4b7918a0f admin admin] RBAC: Adding query filter params (type=placement) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:09.379219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa465b-d8d5-4102-b0a6-f3e4b7918a0f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:09.380519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa465b-d8d5-4102-b0a6-f3e4b7918a0f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:09.385544 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 648/1290] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Dec 13 16:39:09 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:39:11.733181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4488ad-1f4f-4eed-babb-05409be27b33 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:11.733732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4488ad-1f4f-4eed-babb-05409be27b33 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:11.733732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4488ad-1f4f-4eed-babb-05409be27b33 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:11.735585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 643/1291] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:39:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:39:11.742535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c710d9-46e5-47c3-8712-52caa800b81f None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:11.743223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c710d9-46e5-47c3-8712-52caa800b81f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:11.743439 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c710d9-46e5-47c3-8712-52caa800b81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:11.766127 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b9c710d9-46e5-47c3-8712-52caa800b81f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:39:11.767329 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b9c710d9-46e5-47c3-8712-52caa800b81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:39:11.775784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 649/1292] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:39:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:39:11.800145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4488ad-1f4f-4eed-babb-05409be27b33 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:11.812469 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4488ad-1f4f-4eed-babb-05409be27b33 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:11.817990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9935bd-2897-47fb-a3d8-0eabc32252d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:11.818628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9935bd-2897-47fb-a3d8-0eabc32252d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:11.818907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9935bd-2897-47fb-a3d8-0eabc32252d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:11.819172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9935bd-2897-47fb-a3d8-0eabc32252d2 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:11.819905 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9935bd-2897-47fb-a3d8-0eabc32252d2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:11.821511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9935bd-2897-47fb-a3d8-0eabc32252d2 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:11.843281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 644/1293] 10.222.0.62 () {60 vars in 1162 bytes} [Mon Dec 13 16:39:11 2021] POST /identity/v3/services => generated 246 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:39:14.172289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588a8f2-56e0-4c70-98dc-3c482251a021 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:14.173368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588a8f2-56e0-4c70-98dc-3c482251a021 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:14.173368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588a8f2-56e0-4c70-98dc-3c482251a021 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:14.177768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 650/1294] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:39:14 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:39:14.186822 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae74cc1-e020-47db-bd0b-c33bf1abe1e7 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:14.187322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae74cc1-e020-47db-bd0b-c33bf1abe1e7 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:14.187322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae74cc1-e020-47db-bd0b-c33bf1abe1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:14.206785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-fae74cc1-e020-47db-bd0b-c33bf1abe1e7 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:39:14.207949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fae74cc1-e020-47db-bd0b-c33bf1abe1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:39:14.226729 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 645/1295] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:39:14 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:39:14.261505 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588a8f2-56e0-4c70-98dc-3c482251a021 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:14.277032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588a8f2-56e0-4c70-98dc-3c482251a021 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:14.284345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba652c1-c66b-4e4f-9a1d-8870c1d26e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:14.285618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba652c1-c66b-4e4f-9a1d-8870c1d26e63 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:14.286075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba652c1-c66b-4e4f-9a1d-8870c1d26e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:14.286516 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba652c1-c66b-4e4f-9a1d-8870c1d26e63 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:14.287580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba652c1-c66b-4e4f-9a1d-8870c1d26e63 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:14.290324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba652c1-c66b-4e4f-9a1d-8870c1d26e63 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:14.304601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-3ba652c1-c66b-4e4f-9a1d-8870c1d26e63 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 13 16:39:14.305761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 651/1296] 10.222.0.62 () {56 vars in 1138 bytes} [Mon Dec 13 16:39:14 2021] GET /identity/v3/services/placement => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:14.312638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae74cc1-e020-47db-bd0b-c33bf1abe1e7 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:14.330221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae74cc1-e020-47db-bd0b-c33bf1abe1e7 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:14.338397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4835ed-0270-4a7f-b553-4c94d20b7e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:14.339065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4835ed-0270-4a7f-b553-4c94d20b7e01 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:14.339335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4835ed-0270-4a7f-b553-4c94d20b7e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:14.339601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4835ed-0270-4a7f-b553-4c94d20b7e01 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:14.340355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4835ed-0270-4a7f-b553-4c94d20b7e01 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:14.340677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4835ed-0270-4a7f-b553-4c94d20b7e01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:14.342294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4835ed-0270-4a7f-b553-4c94d20b7e01 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:14.348374 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 646/1297] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Dec 13 16:39:14 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:14.355272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba652c1-c66b-4e4f-9a1d-8870c1d26e63 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:14.365687 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba652c1-c66b-4e4f-9a1d-8870c1d26e63 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:14.371580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde52bd3-dafb-412d-a4a4-15e1f6e07dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:14.372218 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52bd3-dafb-412d-a4a4-15e1f6e07dbc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:14.372494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52bd3-dafb-412d-a4a4-15e1f6e07dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:14.372792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52bd3-dafb-412d-a4a4-15e1f6e07dbc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:14.373583 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde52bd3-dafb-412d-a4a4-15e1f6e07dbc admin admin] RBAC: Adding query filter params (interface=public, service_id=c7c1d9a440a6488a9fa9302517573d1a, region_id=RegionOne) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:14.373887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde52bd3-dafb-412d-a4a4-15e1f6e07dbc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:14.375472 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde52bd3-dafb-412d-a4a4-15e1f6e07dbc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:14.381190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 652/1298] 10.222.0.62 () {56 vars in 1272 bytes} [Mon Dec 13 16:39:14 2021] GET /identity/v3/endpoints?service_id=c7c1d9a440a6488a9fa9302517573d1a&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:14.387373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4835ed-0270-4a7f-b553-4c94d20b7e01 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:14.398228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4835ed-0270-4a7f-b553-4c94d20b7e01 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:14.404773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5f898-cc71-4653-a5c1-fa247df7fec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:14.405411 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5f898-cc71-4653-a5c1-fa247df7fec3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:14.405690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5f898-cc71-4653-a5c1-fa247df7fec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:14.405965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5f898-cc71-4653-a5c1-fa247df7fec3 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:14.406800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5f898-cc71-4653-a5c1-fa247df7fec3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:14.408404 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5f898-cc71-4653-a5c1-fa247df7fec3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:14.416023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 647/1299] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Dec 13 16:39:14 2021] GET /identity/v3/services => generated 2191 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:39:16.738327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452e9b9-84e2-4230-9106-97858727d10f None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:16.738924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452e9b9-84e2-4230-9106-97858727d10f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:16.738924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452e9b9-84e2-4230-9106-97858727d10f None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:16.740668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 653/1300] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:39:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:39:16.747360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aad5b-5a3a-4338-8447-308d6e5ee9a6 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:16.748033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aad5b-5a3a-4338-8447-308d6e5ee9a6 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:16.748146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aad5b-5a3a-4338-8447-308d6e5ee9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:16.773450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-561aad5b-5a3a-4338-8447-308d6e5ee9a6 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:39:16.774616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-561aad5b-5a3a-4338-8447-308d6e5ee9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:39:16.783391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 648/1301] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:39:16 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:39:16.807192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452e9b9-84e2-4230-9106-97858727d10f None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:16.820392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452e9b9-84e2-4230-9106-97858727d10f None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:16.825622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eef16d-9fe6-40ab-a03f-e1ea2abdc470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:16.826394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eef16d-9fe6-40ab-a03f-e1ea2abdc470 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:16.826673 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eef16d-9fe6-40ab-a03f-e1ea2abdc470 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:16.826944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eef16d-9fe6-40ab-a03f-e1ea2abdc470 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:16.827593 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eef16d-9fe6-40ab-a03f-e1ea2abdc470 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:16.829331 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eef16d-9fe6-40ab-a03f-e1ea2abdc470 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:16.840246 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING keystone.server.flask.application [None req-99eef16d-9fe6-40ab-a03f-e1ea2abdc470 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Dec 13 16:39:16.841400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 654/1302] 10.222.0.62 () {56 vars in 1138 bytes} [Mon Dec 13 16:39:16 2021] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Dec 13 16:39:16.847859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aad5b-5a3a-4338-8447-308d6e5ee9a6 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:16.856840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aad5b-5a3a-4338-8447-308d6e5ee9a6 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:16.862573 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6662d78-f951-46cf-9516-16f7a634e212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:16.863217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6662d78-f951-46cf-9516-16f7a634e212 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:16.863492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6662d78-f951-46cf-9516-16f7a634e212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:16.863756 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6662d78-f951-46cf-9516-16f7a634e212 admin admin] PATH_INFO: `/v3/services` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:16.864468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6662d78-f951-46cf-9516-16f7a634e212 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:39:16.864797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6662d78-f951-46cf-9516-16f7a634e212 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:16.866386 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6662d78-f951-46cf-9516-16f7a634e212 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:16.871654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 649/1303] 10.222.0.62 () {56 vars in 1137 bytes} [Mon Dec 13 16:39:16 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:39:16.877781 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eef16d-9fe6-40ab-a03f-e1ea2abdc470 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:39:16.889152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eef16d-9fe6-40ab-a03f-e1ea2abdc470 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:39:16.894164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126e5bf-2341-410b-ae1c-ed63ea60b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:39:16.894770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126e5bf-2341-410b-ae1c-ed63ea60b8ab admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:39:16.895052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126e5bf-2341-410b-ae1c-ed63ea60b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:39:16.895323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126e5bf-2341-410b-ae1c-ed63ea60b8ab admin admin] PATH_INFO: `/v3/endpoints` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:39:16.896056 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126e5bf-2341-410b-ae1c-ed63ea60b8ab admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:39:16.897640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126e5bf-2341-410b-ae1c-ed63ea60b8ab admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:39:16.919214 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 655/1304] 10.222.0.62 () {60 vars in 1165 bytes} [Mon Dec 13 16:39:16 2021] POST /identity/v3/endpoints => generated 331 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:40:20.331138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad8fc4-fedc-48ab-810a-9059aa0f14f9 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:20.331693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad8fc4-fedc-48ab-810a-9059aa0f14f9 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:20.331693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad8fc4-fedc-48ab-810a-9059aa0f14f9 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:20.333834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 650/1305] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:40:20.343260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499b4d3-ffb9-455d-a648-a23df2fe72cc None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:20.344238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499b4d3-ffb9-455d-a648-a23df2fe72cc None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:20.344775 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499b4d3-ffb9-455d-a648-a23df2fe72cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:20.490509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-5499b4d3-ffb9-455d-a648-a23df2fe72cc None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:20.492761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5499b4d3-ffb9-455d-a648-a23df2fe72cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:20.612115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 656/1306] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:40:20.636509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad8fc4-fedc-48ab-810a-9059aa0f14f9 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:20.638686 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2cad8fc4-fedc-48ab-810a-9059aa0f14f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:20.788394 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad8fc4-fedc-48ab-810a-9059aa0f14f9 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:20.881314 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb95558-eaf3-4b67-97dd-03b80a5f432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:20.881982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95558-eaf3-4b67-97dd-03b80a5f432a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:20.882221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95558-eaf3-4b67-97dd-03b80a5f432a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:20.882525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb95558-eaf3-4b67-97dd-03b80a5f432a admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:20.883270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb95558-eaf3-4b67-97dd-03b80a5f432a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:20.885327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb95558-eaf3-4b67-97dd-03b80a5f432a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:20.905008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 651/1307] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Dec 13 16:40:20 2021] GET /identity/v3/projects => generated 2553 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:40:23.417194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f13ff6-f559-431c-af84-66a339dc259d None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:23.417712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f13ff6-f559-431c-af84-66a339dc259d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:23.417712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f13ff6-f559-431c-af84-66a339dc259d None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:23.419445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 657/1308] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:23.425775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24495e-d830-4128-94e6-6534c3158101 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:23.426221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24495e-d830-4128-94e6-6534c3158101 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:23.426400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24495e-d830-4128-94e6-6534c3158101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:23.500757 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-6c24495e-d830-4128-94e6-6534c3158101 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:23.501855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6c24495e-d830-4128-94e6-6534c3158101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:23.598403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 652/1309] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:40:23.649560 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e6459-6619-49d1-ae10-0c58947974d6 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:23.649839 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e6459-6619-49d1-ae10-0c58947974d6 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:23.650280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e6459-6619-49d1-ae10-0c58947974d6 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:23.652159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 658/1310] 10.222.0.62 () {54 vars in 964 bytes} [Mon Dec 13 16:40:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:23.658862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e91a-0753-48d3-bc3d-1c4fb7781006 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:23.659338 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e91a-0753-48d3-bc3d-1c4fb7781006 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:23.659789 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4e91a-0753-48d3-bc3d-1c4fb7781006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:23.740552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-1dd4e91a-0753-48d3-bc3d-1c4fb7781006 None None] MFA Rules not processed for user `51f9a10e3d87475e92fb49686f1aa456`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:23.741762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1dd4e91a-0753-48d3-bc3d-1c4fb7781006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:23.825674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 653/1311] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Dec 13 16:40:23 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:40:23.835573 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e6459-6619-49d1-ae10-0c58947974d6 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:23.837159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4c6e6459-6619-49d1-ae10-0c58947974d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:23.954721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e6459-6619-49d1-ae10-0c58947974d6 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:24.026655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f69d4d-5e95-4cb5-9e02-b64162ed6704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:24.027217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69d4d-5e95-4cb5-9e02-b64162ed6704 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:24.027472 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69d4d-5e95-4cb5-9e02-b64162ed6704 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:24.027769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f69d4d-5e95-4cb5-9e02-b64162ed6704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:24.029713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-92f69d4d-5e95-4cb5-9e02-b64162ed6704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:24.139929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f69d4d-5e95-4cb5-9e02-b64162ed6704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:24.141449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f69d4d-5e95-4cb5-9e02-b64162ed6704 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:24.159840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 659/1312] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:40:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:40:26.758883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79106ec-7189-47e5-a51b-2424cea64aed None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:26.759778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79106ec-7189-47e5-a51b-2424cea64aed None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:26.759778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79106ec-7189-47e5-a51b-2424cea64aed None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:26.763253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 654/1313] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:26 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:26.773019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553989a-216b-48d4-b016-ec558f483194 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:26.773789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553989a-216b-48d4-b016-ec558f483194 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:26.773944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553989a-216b-48d4-b016-ec558f483194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:26.850446 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-5553989a-216b-48d4-b016-ec558f483194 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:26.851645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5553989a-216b-48d4-b016-ec558f483194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:26.947960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 660/1314] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:40:27.017019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95722fcb-4b1f-4a07-9205-7d3e7698a0c4 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:27.017215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95722fcb-4b1f-4a07-9205-7d3e7698a0c4 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:27.017576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95722fcb-4b1f-4a07-9205-7d3e7698a0c4 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:27.020369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 655/1315] 10.222.0.62 () {54 vars in 964 bytes} [Mon Dec 13 16:40:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:27.027381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93fb5e-ca76-48bb-9633-5d7be5a47dde None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:27.027749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93fb5e-ca76-48bb-9633-5d7be5a47dde None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:27.028152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93fb5e-ca76-48bb-9633-5d7be5a47dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:27.112338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7b93fb5e-ca76-48bb-9633-5d7be5a47dde None None] MFA Rules not processed for user `51f9a10e3d87475e92fb49686f1aa456`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:27.113595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7b93fb5e-ca76-48bb-9633-5d7be5a47dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:27.194291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 661/1316] 10.222.0.62 () {58 vars in 1061 bytes} [Mon Dec 13 16:40:27 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:40:27.204123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95722fcb-4b1f-4a07-9205-7d3e7698a0c4 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:27.205690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-95722fcb-4b1f-4a07-9205-7d3e7698a0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:27.322507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95722fcb-4b1f-4a07-9205-7d3e7698a0c4 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:27.396986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f820a9-983f-4b7f-9981-5c77731e6244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:27.397630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f820a9-983f-4b7f-9981-5c77731e6244 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:27.397913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f820a9-983f-4b7f-9981-5c77731e6244 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:27.398185 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f820a9-983f-4b7f-9981-5c77731e6244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:27.399817 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b8f820a9-983f-4b7f-9981-5c77731e6244 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:27.513223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f820a9-983f-4b7f-9981-5c77731e6244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:27.514678 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f820a9-983f-4b7f-9981-5c77731e6244 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:27.533349 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 656/1317] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:40:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:40:30.431949 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541234c-28d9-44f4-ba28-fccd82e4fb8e None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:30.432855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541234c-28d9-44f4-ba28-fccd82e4fb8e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:30.432855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541234c-28d9-44f4-ba28-fccd82e4fb8e None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:30.435583 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 662/1318] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:30 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:30.444711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2862b5-12f8-4ff2-bada-c0fd6df52f4c None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:30.445139 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2862b5-12f8-4ff2-bada-c0fd6df52f4c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:30.445315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2862b5-12f8-4ff2-bada-c0fd6df52f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:30.519338 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-8f2862b5-12f8-4ff2-bada-c0fd6df52f4c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:30.520525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8f2862b5-12f8-4ff2-bada-c0fd6df52f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:30.632032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 657/1319] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:40:30.669097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541234c-28d9-44f4-ba28-fccd82e4fb8e None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:30.671476 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5541234c-28d9-44f4-ba28-fccd82e4fb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:30.805487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541234c-28d9-44f4-ba28-fccd82e4fb8e None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:30.897507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837cdb0-00d7-449d-ab9f-b14c38d35b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:30.898269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837cdb0-00d7-449d-ab9f-b14c38d35b85 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:30.898540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837cdb0-00d7-449d-ab9f-b14c38d35b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:30.898802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837cdb0-00d7-449d-ab9f-b14c38d35b85 admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:30.908538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837cdb0-00d7-449d-ab9f-b14c38d35b85 admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:30.910622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837cdb0-00d7-449d-ab9f-b14c38d35b85 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:30.912286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 663/1320] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:40:30 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:40:30.925446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2862b5-12f8-4ff2-bada-c0fd6df52f4c None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:30.926667 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8f2862b5-12f8-4ff2-bada-c0fd6df52f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:31.026940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2862b5-12f8-4ff2-bada-c0fd6df52f4c None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:31.098625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c01b5d-0aba-45cf-ab43-1ceca6a99b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:31.099280 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01b5d-0aba-45cf-ab43-1ceca6a99b16 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:31.099557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01b5d-0aba-45cf-ab43-1ceca6a99b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:31.099833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01b5d-0aba-45cf-ab43-1ceca6a99b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:31.101498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-08c01b5d-0aba-45cf-ab43-1ceca6a99b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:31.216869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c01b5d-0aba-45cf-ab43-1ceca6a99b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:31.218321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c01b5d-0aba-45cf-ab43-1ceca6a99b16 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:31.237425 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 658/1321] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:40:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:40:34.161268 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4e0fa-34c5-4280-b450-add92651effb None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:34.162195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4e0fa-34c5-4280-b450-add92651effb None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:34.162195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4e0fa-34c5-4280-b450-add92651effb None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:34.165045 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 664/1322] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:34 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:34.174911 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fe980-df28-463a-9492-12c427313157 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:34.175347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fe980-df28-463a-9492-12c427313157 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:34.175483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7fe980-df28-463a-9492-12c427313157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:34.250425 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-1f7fe980-df28-463a-9492-12c427313157 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:34.251616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1f7fe980-df28-463a-9492-12c427313157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:34.350575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 659/1323] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:40:34.385712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4e0fa-34c5-4280-b450-add92651effb None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:34.387254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-faf4e0fa-34c5-4280-b450-add92651effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:34.516926 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4e0fa-34c5-4280-b450-add92651effb None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:34.616764 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4722b93-9392-4528-9454-2997b064d08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:34.617613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722b93-9392-4528-9454-2997b064d08a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:34.617887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722b93-9392-4528-9454-2997b064d08a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:34.618155 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4722b93-9392-4528-9454-2997b064d08a admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:34.628174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4722b93-9392-4528-9454-2997b064d08a admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:34.630607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4722b93-9392-4528-9454-2997b064d08a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:34.632289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 665/1324] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:40:34 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:40:34.648126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fe980-df28-463a-9492-12c427313157 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:34.649353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1f7fe980-df28-463a-9492-12c427313157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:34.741034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7fe980-df28-463a-9492-12c427313157 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:34.818643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4faa39a-be82-4a3b-b85a-9389dde707d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:34.819541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faa39a-be82-4a3b-b85a-9389dde707d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:34.819886 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faa39a-be82-4a3b-b85a-9389dde707d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:34.820219 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4faa39a-be82-4a3b-b85a-9389dde707d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:34.822855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d4faa39a-be82-4a3b-b85a-9389dde707d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:34.935840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4faa39a-be82-4a3b-b85a-9389dde707d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:34.937324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4faa39a-be82-4a3b-b85a-9389dde707d7 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:34.956313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 660/1325] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:40:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:40:38.013228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015051ac-1c61-43ee-8661-a359a7f013ba None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:38.013788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015051ac-1c61-43ee-8661-a359a7f013ba None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:38.013788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015051ac-1c61-43ee-8661-a359a7f013ba None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:38.015612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 666/1326] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:38.021824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50707c-5b8c-444c-89fc-5d1e810180b9 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:38.022298 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50707c-5b8c-444c-89fc-5d1e810180b9 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:38.022413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50707c-5b8c-444c-89fc-5d1e810180b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:38.089604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-8b50707c-5b8c-444c-89fc-5d1e810180b9 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:38.091113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8b50707c-5b8c-444c-89fc-5d1e810180b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:38.194855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 661/1327] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:40:38.232378 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015051ac-1c61-43ee-8661-a359a7f013ba None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:38.233936 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-015051ac-1c61-43ee-8661-a359a7f013ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:38.338982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015051ac-1c61-43ee-8661-a359a7f013ba None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:38.411753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e68e68-6869-47ea-a9f0-2d4d1e540abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:38.412404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e68e68-6869-47ea-a9f0-2d4d1e540abd service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:38.412712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e68e68-6869-47ea-a9f0-2d4d1e540abd service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:38.412986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e68e68-6869-47ea-a9f0-2d4d1e540abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:38.414602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a3e68e68-6869-47ea-a9f0-2d4d1e540abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:38.524842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e68e68-6869-47ea-a9f0-2d4d1e540abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:38.526199 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e68e68-6869-47ea-a9f0-2d4d1e540abd service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:38.544773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 667/1328] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:40:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:40:41.012079 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadb6d5-b359-4d5c-9496-600ff3350d03 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:41.012707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadb6d5-b359-4d5c-9496-600ff3350d03 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:41.013252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcadb6d5-b359-4d5c-9496-600ff3350d03 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:41.015059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 662/1329] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:41.021023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0250ec-7be1-4c85-9dcd-ca8d6f856281 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:41.021464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0250ec-7be1-4c85-9dcd-ca8d6f856281 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:41.021553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0250ec-7be1-4c85-9dcd-ca8d6f856281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:41.088513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-bd0250ec-7be1-4c85-9dcd-ca8d6f856281 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:41.089707 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bd0250ec-7be1-4c85-9dcd-ca8d6f856281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:41.196428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 668/1330] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:40:41.234334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadb6d5-b359-4d5c-9496-600ff3350d03 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:41.235852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-dcadb6d5-b359-4d5c-9496-600ff3350d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:41.345470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcadb6d5-b359-4d5c-9496-600ff3350d03 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:41.417996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e64781-037d-4fba-8dbd-bea959c4264d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:41.418710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64781-037d-4fba-8dbd-bea959c4264d service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:41.418996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64781-037d-4fba-8dbd-bea959c4264d service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:41.419263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e64781-037d-4fba-8dbd-bea959c4264d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:41.420907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b6e64781-037d-4fba-8dbd-bea959c4264d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:41.529513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e64781-037d-4fba-8dbd-bea959c4264d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:41.530952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e64781-037d-4fba-8dbd-bea959c4264d service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:41.549158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 663/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:40:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:40:44.018584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b367-e8c4-4129-a66f-5f4a917b5664 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:44.019182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b367-e8c4-4129-a66f-5f4a917b5664 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:44.019182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54b367-e8c4-4129-a66f-5f4a917b5664 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:44.020904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 669/1332] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:44.026812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766befd-9273-4248-a9ec-9163a482d681 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:44.027220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766befd-9273-4248-a9ec-9163a482d681 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:44.027413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2766befd-9273-4248-a9ec-9163a482d681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:44.096176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-2766befd-9273-4248-a9ec-9163a482d681 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:44.097499 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2766befd-9273-4248-a9ec-9163a482d681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:44.194758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 664/1333] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:40:44.228029 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54b367-e8c4-4129-a66f-5f4a917b5664 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:44.229700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3d54b367-e8c4-4129-a66f-5f4a917b5664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:44.362433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54b367-e8c4-4129-a66f-5f4a917b5664 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:44.458929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee326a94-1805-4512-8b46-ae0117449e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:44.459734 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee326a94-1805-4512-8b46-ae0117449e7c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:44.460103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee326a94-1805-4512-8b46-ae0117449e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:44.460276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee326a94-1805-4512-8b46-ae0117449e7c admin admin] PATH_INFO: `/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:44.472742 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee326a94-1805-4512-8b46-ae0117449e7c admin admin] RBAC: Authorizing `identity:get_project(project_id=76c905a70f0f4dc58022cf7d31f2b3c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:44.477029 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee326a94-1805-4512-8b46-ae0117449e7c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:44.481062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 670/1334] 10.222.0.62 () {56 vars in 1207 bytes} [Mon Dec 13 16:40:44 2021] GET /identity/v3/projects/76c905a70f0f4dc58022cf7d31f2b3c5 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:40:44.489969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766befd-9273-4248-a9ec-9163a482d681 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:44.492724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2766befd-9273-4248-a9ec-9163a482d681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:44.590233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2766befd-9273-4248-a9ec-9163a482d681 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:44.668595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829ddd1-03d1-4198-9c70-f11969ccbd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:44.669329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829ddd1-03d1-4198-9c70-f11969ccbd92 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:44.669632 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829ddd1-03d1-4198-9c70-f11969ccbd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:44.669949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829ddd1-03d1-4198-9c70-f11969ccbd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:44.672516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b829ddd1-03d1-4198-9c70-f11969ccbd92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:44.788374 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829ddd1-03d1-4198-9c70-f11969ccbd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:44.789822 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829ddd1-03d1-4198-9c70-f11969ccbd92 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:44.808034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 665/1335] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:40:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:40:47.443026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675143e0-a984-4ca2-87fa-b5ee3dfd9a15 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:47.443995 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675143e0-a984-4ca2-87fa-b5ee3dfd9a15 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:47.443995 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675143e0-a984-4ca2-87fa-b5ee3dfd9a15 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:47.446603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 671/1336] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:47 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:47.453952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53bfc2-8fbc-4aa2-ac3f-ae7e66372783 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:47.454408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53bfc2-8fbc-4aa2-ac3f-ae7e66372783 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:47.454521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53bfc2-8fbc-4aa2-ac3f-ae7e66372783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:47.522324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-3f53bfc2-8fbc-4aa2-ac3f-ae7e66372783 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:47.523528 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-3f53bfc2-8fbc-4aa2-ac3f-ae7e66372783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:47.629564 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 666/1337] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:40:47.678935 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675143e0-a984-4ca2-87fa-b5ee3dfd9a15 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:47.681384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-675143e0-a984-4ca2-87fa-b5ee3dfd9a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:47.785667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675143e0-a984-4ca2-87fa-b5ee3dfd9a15 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:47.866435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a852a14-5362-49ed-abe2-d136a7c0b5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:47.867077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a852a14-5362-49ed-abe2-d136a7c0b5ac service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:47.867350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a852a14-5362-49ed-abe2-d136a7c0b5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:47.867618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a852a14-5362-49ed-abe2-d136a7c0b5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:47.869257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6a852a14-5362-49ed-abe2-d136a7c0b5ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:47.993653 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a852a14-5362-49ed-abe2-d136a7c0b5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:47.995093 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a852a14-5362-49ed-abe2-d136a7c0b5ac service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:48.021259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 672/1338] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:40:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:40:50.405779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b4ddd-4f5e-4fe1-adb7-3e6c6eb578fa None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:50.406357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b4ddd-4f5e-4fe1-adb7-3e6c6eb578fa None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:50.406357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b4ddd-4f5e-4fe1-adb7-3e6c6eb578fa None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:50.408169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 667/1339] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:50.415004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be603a9a-b32d-44e2-b966-d8c55e747fe5 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:50.415782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be603a9a-b32d-44e2-b966-d8c55e747fe5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:50.415937 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be603a9a-b32d-44e2-b966-d8c55e747fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:50.491985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-be603a9a-b32d-44e2-b966-d8c55e747fe5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:50.493206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-be603a9a-b32d-44e2-b966-d8c55e747fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:50.605044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 673/1340] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:40:50.657731 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b4ddd-4f5e-4fe1-adb7-3e6c6eb578fa None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:50.660388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b14b4ddd-4f5e-4fe1-adb7-3e6c6eb578fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:50.778152 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b4ddd-4f5e-4fe1-adb7-3e6c6eb578fa None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:50.781929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3f103-1c4b-4db7-a6fa-8527dbda2943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:50.782568 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3f103-1c4b-4db7-a6fa-8527dbda2943 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:50.782840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3f103-1c4b-4db7-a6fa-8527dbda2943 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:50.783107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3f103-1c4b-4db7-a6fa-8527dbda2943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:50.784913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-85a3f103-1c4b-4db7-a6fa-8527dbda2943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:50.796774 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3f103-1c4b-4db7-a6fa-8527dbda2943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:50.798202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3f103-1c4b-4db7-a6fa-8527dbda2943 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:50.807174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 668/1341] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:40:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:40:53.506979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85912691-e810-48c1-bfb1-423fd14e143e None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:53.507562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85912691-e810-48c1-bfb1-423fd14e143e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:53.507562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85912691-e810-48c1-bfb1-423fd14e143e None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:53.510046 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 674/1342] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:53.517414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b449458-0c7e-4873-9d06-0d1d238ce670 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:53.517854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b449458-0c7e-4873-9d06-0d1d238ce670 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:53.517993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b449458-0c7e-4873-9d06-0d1d238ce670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:53.536529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7b449458-0c7e-4873-9d06-0d1d238ce670 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:53.537745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7b449458-0c7e-4873-9d06-0d1d238ce670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:53.546433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 669/1343] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:40:53.586387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85912691-e810-48c1-bfb1-423fd14e143e None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:53.599321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85912691-e810-48c1-bfb1-423fd14e143e None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:53.603946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803a28b-2aab-4628-9672-11721a17a5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:53.604598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803a28b-2aab-4628-9672-11721a17a5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:53.604898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803a28b-2aab-4628-9672-11721a17a5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:53.605170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803a28b-2aab-4628-9672-11721a17a5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:53.614548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803a28b-2aab-4628-9672-11721a17a5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:53.615983 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803a28b-2aab-4628-9672-11721a17a5c8 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:53.625484 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 675/1344] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:40:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:40:57.989206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0104c1-e181-4f7c-9706-148d099366cc None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:57.989806 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0104c1-e181-4f7c-9706-148d099366cc None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:57.989806 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0104c1-e181-4f7c-9706-148d099366cc None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:57.991560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 670/1345] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:40:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:40:57.997471 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1761b-433d-4860-99f6-4912ce6020e0 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:57.997932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1761b-433d-4860-99f6-4912ce6020e0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:57.998031 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1761b-433d-4860-99f6-4912ce6020e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:58.016731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-f1a1761b-433d-4860-99f6-4912ce6020e0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:40:58.017932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f1a1761b-433d-4860-99f6-4912ce6020e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:58.026413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 676/1346] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:40:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:40:58.066449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0104c1-e181-4f7c-9706-148d099366cc None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:40:58.068328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ea0104c1-e181-4f7c-9706-148d099366cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:40:58.083108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0104c1-e181-4f7c-9706-148d099366cc None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:40:58.093678 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fdd2a-0047-48b3-90ee-7526fd0c33bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:40:58.094337 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdd2a-0047-48b3-90ee-7526fd0c33bf service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:40:58.094623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdd2a-0047-48b3-90ee-7526fd0c33bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:40:58.094900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fdd2a-0047-48b3-90ee-7526fd0c33bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:40:58.104467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fdd2a-0047-48b3-90ee-7526fd0c33bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:40:58.105961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fdd2a-0047-48b3-90ee-7526fd0c33bf service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:40:58.115569 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 671/1347] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:40:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:01.506003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e272ecf-5d7b-4814-9b2d-56ae4e0e1764 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:01.506571 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e272ecf-5d7b-4814-9b2d-56ae4e0e1764 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:01.506571 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e272ecf-5d7b-4814-9b2d-56ae4e0e1764 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:01.508470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 677/1348] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:01.515799 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ceed8-5585-45b8-851c-0bd9091a0d3f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:01.516359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ceed8-5585-45b8-851c-0bd9091a0d3f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:01.516359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ceed8-5585-45b8-851c-0bd9091a0d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:01.538923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-286ceed8-5585-45b8-851c-0bd9091a0d3f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:01.540261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-286ceed8-5585-45b8-851c-0bd9091a0d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:01.550316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 672/1349] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:01.595665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e272ecf-5d7b-4814-9b2d-56ae4e0e1764 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:01.607899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e272ecf-5d7b-4814-9b2d-56ae4e0e1764 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:01.611777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced4eee-b61f-4391-b634-c7b62112d8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:01.612424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced4eee-b61f-4391-b634-c7b62112d8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:01.612735 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced4eee-b61f-4391-b634-c7b62112d8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:01.613005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced4eee-b61f-4391-b634-c7b62112d8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:01.623406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced4eee-b61f-4391-b634-c7b62112d8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:01.624914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced4eee-b61f-4391-b634-c7b62112d8b2 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:01.635756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 678/1350] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:06.077870 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f151e-a5ec-46b2-b8ad-0b02d982692e None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:06.078469 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f151e-a5ec-46b2-b8ad-0b02d982692e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:06.078469 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f151e-a5ec-46b2-b8ad-0b02d982692e None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:06.080214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 673/1351] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:06.086287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a033-cc17-4ab5-994b-ba3a2822c39f None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:06.086726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a033-cc17-4ab5-994b-ba3a2822c39f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:06.086907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33a033-cc17-4ab5-994b-ba3a2822c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:06.106884 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7a33a033-cc17-4ab5-994b-ba3a2822c39f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:06.108095 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7a33a033-cc17-4ab5-994b-ba3a2822c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:06.116094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 679/1352] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:06.163454 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f151e-a5ec-46b2-b8ad-0b02d982692e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:06.175970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f151e-a5ec-46b2-b8ad-0b02d982692e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:06.180057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c4748-0167-4412-a057-e94bbba60712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:06.180798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4748-0167-4412-a057-e94bbba60712 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:06.181016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4748-0167-4412-a057-e94bbba60712 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:06.181283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c4748-0167-4412-a057-e94bbba60712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:06.191509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c4748-0167-4412-a057-e94bbba60712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:06.192986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c4748-0167-4412-a057-e94bbba60712 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:06.202431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 674/1353] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:11.163103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13e5a-03fb-4359-b429-25a0cdc6394d None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:11.164063 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13e5a-03fb-4359-b429-25a0cdc6394d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:11.164541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f13e5a-03fb-4359-b429-25a0cdc6394d None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:11.166941 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 680/1354] 10.222.0.62 () {54 vars in 921 bytes} [Mon Dec 13 16:41:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:11.173034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe2f3-b319-4055-804a-fd416d6eb640 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:11.173887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe2f3-b319-4055-804a-fd416d6eb640 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:11.174365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fe2f3-b319-4055-804a-fd416d6eb640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:11.278962 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d20fe2f3-b319-4055-804a-fd416d6eb640 None None] MFA Rules not processed for user `02b7187c26dd41bea9f3c2b49de8ef28`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:11.280149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d20fe2f3-b319-4055-804a-fd416d6eb640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:11.352900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 675/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Dec 13 16:41:11 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:15.399835 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547c735-721b-44a4-a8bd-43dd8e30549a None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:15.400372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547c735-721b-44a4-a8bd-43dd8e30549a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:15.400372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547c735-721b-44a4-a8bd-43dd8e30549a None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:15.402232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 681/1356] 10.222.0.62 () {54 vars in 921 bytes} [Mon Dec 13 16:41:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:15.407773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9e488-47fa-48b9-acb6-2012afb509f3 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:15.408217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9e488-47fa-48b9-acb6-2012afb509f3 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:15.408333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9e488-47fa-48b9-acb6-2012afb509f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:15.427662 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-27c9e488-47fa-48b9-acb6-2012afb509f3 None None] MFA Rules not processed for user `02b7187c26dd41bea9f3c2b49de8ef28`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:15.428883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-27c9e488-47fa-48b9-acb6-2012afb509f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:15.438326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 676/1357] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Dec 13 16:41:15 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:17.065764 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee35951-b116-40fb-8421-893a5f34fe9d None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:17.066370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee35951-b116-40fb-8421-893a5f34fe9d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:17.066370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee35951-b116-40fb-8421-893a5f34fe9d None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:17.067994 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 682/1358] 10.222.0.62 () {54 vars in 921 bytes} [Mon Dec 13 16:41:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:17.073617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a6203-37ae-485e-a7ad-257dadab99f8 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:17.074642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a6203-37ae-485e-a7ad-257dadab99f8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:17.074974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a6203-37ae-485e-a7ad-257dadab99f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:17.093804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-950a6203-37ae-485e-a7ad-257dadab99f8 None None] MFA Rules not processed for user `02b7187c26dd41bea9f3c2b49de8ef28`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:17.094991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-950a6203-37ae-485e-a7ad-257dadab99f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:17.103655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 677/1359] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Dec 13 16:41:17 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:21.038468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc8eaf-d2ab-4474-b060-791947201f24 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:21.039062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc8eaf-d2ab-4474-b060-791947201f24 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:21.039062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc8eaf-d2ab-4474-b060-791947201f24 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:21.045426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 683/1360] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:21 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:21.046892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0666607-3f05-4e16-ac2f-2ab7e4582815 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:21.047340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0666607-3f05-4e16-ac2f-2ab7e4582815 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:21.047430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0666607-3f05-4e16-ac2f-2ab7e4582815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:21.067583 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-e0666607-3f05-4e16-ac2f-2ab7e4582815 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:21.069049 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e0666607-3f05-4e16-ac2f-2ab7e4582815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:21.077063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 678/1361] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:21.129074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128595b8-3356-404b-a991-cad58c42ae06 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:21.129398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128595b8-3356-404b-a991-cad58c42ae06 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:21.129667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128595b8-3356-404b-a991-cad58c42ae06 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:21.131666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 684/1362] 10.222.0.62 () {54 vars in 961 bytes} [Mon Dec 13 16:41:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:21.137748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb42-58ad-446f-b722-835b71bcf871 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:21.138004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb42-58ad-446f-b722-835b71bcf871 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:21.138501 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbebb42-58ad-446f-b722-835b71bcf871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:21.190898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-bcbebb42-58ad-446f-b722-835b71bcf871 None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:21.192111 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-bcbebb42-58ad-446f-b722-835b71bcf871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:21.274420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 679/1363] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Dec 13 16:41:21 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:41:21.283376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128595b8-3356-404b-a991-cad58c42ae06 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:21.298354 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128595b8-3356-404b-a991-cad58c42ae06 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:21.303803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe8dde6-1e05-472a-b687-d7e65876c076 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:21.304505 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8dde6-1e05-472a-b687-d7e65876c076 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:21.304882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8dde6-1e05-472a-b687-d7e65876c076 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:21.305200 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe8dde6-1e05-472a-b687-d7e65876c076 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:21.313816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8dde6-1e05-472a-b687-d7e65876c076 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:21.315488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe8dde6-1e05-472a-b687-d7e65876c076 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:21.325987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 685/1364] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:41:24.003912 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf61536-800d-44bd-a239-18b258a590d1 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:24.004450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf61536-800d-44bd-a239-18b258a590d1 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:24.004450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf61536-800d-44bd-a239-18b258a590d1 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:24.006373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 680/1365] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:24.012495 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf5ef3-1a4e-4469-a004-65ccbb881eb5 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:24.012495 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf5ef3-1a4e-4469-a004-65ccbb881eb5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:24.012495 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf5ef3-1a4e-4469-a004-65ccbb881eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:24.030339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-94cf5ef3-1a4e-4469-a004-65ccbb881eb5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:24.031495 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-94cf5ef3-1a4e-4469-a004-65ccbb881eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:24.041127 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 686/1366] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:41:24.085408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf61536-800d-44bd-a239-18b258a590d1 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:24.101138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf61536-800d-44bd-a239-18b258a590d1 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:24.108043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ae2ba-7768-41fa-9781-03b6f3415fb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:24.108878 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae2ba-7768-41fa-9781-03b6f3415fb4 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:24.109377 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae2ba-7768-41fa-9781-03b6f3415fb4 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:24.109758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ae2ba-7768-41fa-9781-03b6f3415fb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:24.119016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ae2ba-7768-41fa-9781-03b6f3415fb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:24.121376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ae2ba-7768-41fa-9781-03b6f3415fb4 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:24.132820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 681/1367] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:26.879299 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0afd21-9e1e-4462-bd3c-6a8356f30878 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:26.879843 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0afd21-9e1e-4462-bd3c-6a8356f30878 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:26.879843 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0afd21-9e1e-4462-bd3c-6a8356f30878 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:26.881621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 687/1368] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:26.887711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651971a-dcc7-412e-8ae4-d861cf239c1a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:26.888172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651971a-dcc7-412e-8ae4-d861cf239c1a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:26.888252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651971a-dcc7-412e-8ae4-d861cf239c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:26.910676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-9651971a-dcc7-412e-8ae4-d861cf239c1a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:26.912873 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9651971a-dcc7-412e-8ae4-d861cf239c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:26.922564 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 682/1369] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:26.970406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ab678-f948-46dc-82ee-4d625982f5ef None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:26.970793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ab678-f948-46dc-82ee-4d625982f5ef None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:26.971132 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ab678-f948-46dc-82ee-4d625982f5ef None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:26.973012 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 688/1370] 10.222.0.62 () {54 vars in 961 bytes} [Mon Dec 13 16:41:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:26.982784 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241bb38-d5e6-450e-9d34-ba92855cab22 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:26.983386 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241bb38-d5e6-450e-9d34-ba92855cab22 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:26.983879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241bb38-d5e6-450e-9d34-ba92855cab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:27.003241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-1241bb38-d5e6-450e-9d34-ba92855cab22 None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:27.004511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1241bb38-d5e6-450e-9d34-ba92855cab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:27.014071 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 683/1371] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Dec 13 16:41:26 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:27.021936 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ab678-f948-46dc-82ee-4d625982f5ef None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:27.035829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ab678-f948-46dc-82ee-4d625982f5ef None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:27.044041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfadd8-4beb-4957-87e4-9d57c773df10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:27.044728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfadd8-4beb-4957-87e4-9d57c773df10 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:27.045007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfadd8-4beb-4957-87e4-9d57c773df10 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:27.045278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfadd8-4beb-4957-87e4-9d57c773df10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:27.053767 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfadd8-4beb-4957-87e4-9d57c773df10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:27.055537 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfadd8-4beb-4957-87e4-9d57c773df10 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:27.065303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 689/1372] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:29.043098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d775-ca2a-4b7d-921c-a42e15a420e7 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:29.043722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d775-ca2a-4b7d-921c-a42e15a420e7 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:29.043722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7d775-ca2a-4b7d-921c-a42e15a420e7 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:29.045407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 684/1373] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:29.051502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1727b0-109d-499b-a4b4-1db15d31eeca None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:29.052298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1727b0-109d-499b-a4b4-1db15d31eeca None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:29.052541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1727b0-109d-499b-a4b4-1db15d31eeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:29.071094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-0a1727b0-109d-499b-a4b4-1db15d31eeca None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:29.072187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0a1727b0-109d-499b-a4b4-1db15d31eeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:29.081134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 690/1374] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:29.133483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdd6a-9629-4ec0-853a-b79fba6855a9 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:29.133942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdd6a-9629-4ec0-853a-b79fba6855a9 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:29.136252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fdd6a-9629-4ec0-853a-b79fba6855a9 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:29.138326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 685/1375] 10.222.0.62 () {54 vars in 963 bytes} [Mon Dec 13 16:41:29 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:29.144032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb600c-b80e-4680-9f6c-37c4132043fc None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:29.144529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb600c-b80e-4680-9f6c-37c4132043fc None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:29.144984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb600c-b80e-4680-9f6c-37c4132043fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:29.194615 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7dcb600c-b80e-4680-9f6c-37c4132043fc None None] MFA Rules not processed for user `20f42eb51a824f69a6f77c5044300da2`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:29.195793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7dcb600c-b80e-4680-9f6c-37c4132043fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:29.256517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 691/1376] 10.222.0.62 () {58 vars in 1060 bytes} [Mon Dec 13 16:41:29 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:29.264482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fdd6a-9629-4ec0-853a-b79fba6855a9 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:29.276027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fdd6a-9629-4ec0-853a-b79fba6855a9 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:29.280211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ffa55-bda1-4701-96f8-056d0e1b3754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:29.281027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ffa55-bda1-4701-96f8-056d0e1b3754 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:29.281418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ffa55-bda1-4701-96f8-056d0e1b3754 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:29.281783 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ffa55-bda1-4701-96f8-056d0e1b3754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:29.291239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ffa55-bda1-4701-96f8-056d0e1b3754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:29.293103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ffa55-bda1-4701-96f8-056d0e1b3754 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:29.304451 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 686/1377] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:29.496410 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e038405-0f1f-4fe1-a5c8-885d504fdd86 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:29.496791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e038405-0f1f-4fe1-a5c8-885d504fdd86 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:29.496956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e038405-0f1f-4fe1-a5c8-885d504fdd86 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:29.498934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 692/1378] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:29.505007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a672-8f4c-4cb4-8e35-f992654bbe3b None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:29.505252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a672-8f4c-4cb4-8e35-f992654bbe3b None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:29.505743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02a672-8f4c-4cb4-8e35-f992654bbe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:29.524020 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-6b02a672-8f4c-4cb4-8e35-f992654bbe3b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:29.525215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6b02a672-8f4c-4cb4-8e35-f992654bbe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:29.533089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 687/1379] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:29.578139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e038405-0f1f-4fe1-a5c8-885d504fdd86 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:29.592825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e038405-0f1f-4fe1-a5c8-885d504fdd86 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:29.598560 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd18542-7d83-4751-94c4-3aac44949897 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:29.599190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd18542-7d83-4751-94c4-3aac44949897 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:29.599462 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd18542-7d83-4751-94c4-3aac44949897 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:29.599732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd18542-7d83-4751-94c4-3aac44949897 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:29.608303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd18542-7d83-4751-94c4-3aac44949897 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:29.609923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd18542-7d83-4751-94c4-3aac44949897 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:29.620614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 693/1380] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:32.033676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108b164-2dcb-4af1-9fa9-cee91939b5e7 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:32.034180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108b164-2dcb-4af1-9fa9-cee91939b5e7 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:32.034180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108b164-2dcb-4af1-9fa9-cee91939b5e7 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:32.035970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 688/1381] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:32.042334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ad4c-7d22-42f8-8b3d-56ba5e4e8dcd None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:32.042748 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ad4c-7d22-42f8-8b3d-56ba5e4e8dcd None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:32.042873 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84ad4c-7d22-42f8-8b3d-56ba5e4e8dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:32.061616 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-4e84ad4c-7d22-42f8-8b3d-56ba5e4e8dcd None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:32.062810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4e84ad4c-7d22-42f8-8b3d-56ba5e4e8dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:32.071221 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 694/1382] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:32.116972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108b164-2dcb-4af1-9fa9-cee91939b5e7 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:32.131772 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108b164-2dcb-4af1-9fa9-cee91939b5e7 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:32.137664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0400c-8216-4b64-9207-4d3abd7804c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:32.138308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0400c-8216-4b64-9207-4d3abd7804c0 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:32.138591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0400c-8216-4b64-9207-4d3abd7804c0 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:32.138857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0400c-8216-4b64-9207-4d3abd7804c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:32.147691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0400c-8216-4b64-9207-4d3abd7804c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:32.149346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0400c-8216-4b64-9207-4d3abd7804c0 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:32.159312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 689/1383] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:34.633048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb74a-e2cc-49a5-aedb-db0072846a88 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:34.633590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb74a-e2cc-49a5-aedb-db0072846a88 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:34.633590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcb74a-e2cc-49a5-aedb-db0072846a88 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:34.635778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 695/1384] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:34.641745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4d541-63ac-4e51-befe-b72a0ed7dfc7 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:34.642197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4d541-63ac-4e51-befe-b72a0ed7dfc7 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:34.642311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4d541-63ac-4e51-befe-b72a0ed7dfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:34.660765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d0d4d541-63ac-4e51-befe-b72a0ed7dfc7 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:34.661940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d0d4d541-63ac-4e51-befe-b72a0ed7dfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:34.670750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 690/1385] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:34.716137 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcb74a-e2cc-49a5-aedb-db0072846a88 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:34.731833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcb74a-e2cc-49a5-aedb-db0072846a88 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:34.737747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511577eb-54c8-4d32-9701-ed4aaad5ca81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:34.738527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511577eb-54c8-4d32-9701-ed4aaad5ca81 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:34.738901 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511577eb-54c8-4d32-9701-ed4aaad5ca81 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:34.739265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511577eb-54c8-4d32-9701-ed4aaad5ca81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:34.748986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511577eb-54c8-4d32-9701-ed4aaad5ca81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:34.751342 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511577eb-54c8-4d32-9701-ed4aaad5ca81 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:34.761366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 696/1386] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:37.153649 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb14f6-22ce-4ff5-873a-5d02cf59c045 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:37.154316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb14f6-22ce-4ff5-873a-5d02cf59c045 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:37.154316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb14f6-22ce-4ff5-873a-5d02cf59c045 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:37.155866 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 691/1387] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:37.163600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6449-0984-4d37-869c-9ef0cad0216d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:37.164037 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6449-0984-4d37-869c-9ef0cad0216d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:37.164308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b6449-0984-4d37-869c-9ef0cad0216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:37.188939 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a29b6449-0984-4d37-869c-9ef0cad0216d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:37.190812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a29b6449-0984-4d37-869c-9ef0cad0216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:37.202599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 697/1388] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:37.258976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb14f6-22ce-4ff5-873a-5d02cf59c045 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:37.278438 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb14f6-22ce-4ff5-873a-5d02cf59c045 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:37.285865 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7c59c-129a-46bb-80c0-e0c213989801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:37.286517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c59c-129a-46bb-80c0-e0c213989801 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:37.286801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c59c-129a-46bb-80c0-e0c213989801 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:37.287075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7c59c-129a-46bb-80c0-e0c213989801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:37.295923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7c59c-129a-46bb-80c0-e0c213989801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:37.297567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7c59c-129a-46bb-80c0-e0c213989801 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:37.307678 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 692/1389] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:39.678193 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5b97-9916-424b-aec6-c5c60a9834e3 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:39.678904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5b97-9916-424b-aec6-c5c60a9834e3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:39.678904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade5b97-9916-424b-aec6-c5c60a9834e3 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:39.680461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 698/1390] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:39.686985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0553df-52e2-4d0f-8096-0d8431e741fe None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:39.687494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0553df-52e2-4d0f-8096-0d8431e741fe None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:39.687586 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0553df-52e2-4d0f-8096-0d8431e741fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:39.707108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-0d0553df-52e2-4d0f-8096-0d8431e741fe None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:39.708336 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0d0553df-52e2-4d0f-8096-0d8431e741fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:39.717286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 693/1391] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:39.766273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade5b97-9916-424b-aec6-c5c60a9834e3 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:39.781958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade5b97-9916-424b-aec6-c5c60a9834e3 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:39.787834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927e59d-8cac-4b43-8550-c7f8357ee67d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:39.788469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e59d-8cac-4b43-8550-c7f8357ee67d service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:39.788780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e59d-8cac-4b43-8550-c7f8357ee67d service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:39.789048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927e59d-8cac-4b43-8550-c7f8357ee67d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:39.798859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927e59d-8cac-4b43-8550-c7f8357ee67d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:39.800454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927e59d-8cac-4b43-8550-c7f8357ee67d service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:39.810902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 699/1392] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:42.224742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5103b-837f-4e05-b13f-ec47ea7b932a None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:42.225312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5103b-837f-4e05-b13f-ec47ea7b932a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:42.225312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5103b-837f-4e05-b13f-ec47ea7b932a None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:42.227112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 694/1393] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:42.233148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950ede-486e-4741-b77f-7fece588cb3c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:42.233603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950ede-486e-4741-b77f-7fece588cb3c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:42.233693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27950ede-486e-4741-b77f-7fece588cb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:42.252820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-27950ede-486e-4741-b77f-7fece588cb3c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:42.254015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-27950ede-486e-4741-b77f-7fece588cb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:42.262390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 700/1394] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:41:42.308600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5103b-837f-4e05-b13f-ec47ea7b932a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:42.323607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5103b-837f-4e05-b13f-ec47ea7b932a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:42.329098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256179df-39cb-476f-b0f5-a2dbfb3251a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:42.329761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256179df-39cb-476f-b0f5-a2dbfb3251a5 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:42.330044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256179df-39cb-476f-b0f5-a2dbfb3251a5 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:42.330318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256179df-39cb-476f-b0f5-a2dbfb3251a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:42.339633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256179df-39cb-476f-b0f5-a2dbfb3251a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:42.341317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256179df-39cb-476f-b0f5-a2dbfb3251a5 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:42.352530 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 695/1395] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:44.392183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b137c6-ee07-4b81-8cbf-5e93386c7029 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:44.392804 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b137c6-ee07-4b81-8cbf-5e93386c7029 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:44.392804 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b137c6-ee07-4b81-8cbf-5e93386c7029 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:44.396690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 701/1396] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:44.401464 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665e7a-608b-4145-8337-fc090803cca7 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:44.402067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665e7a-608b-4145-8337-fc090803cca7 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:44.402067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2665e7a-608b-4145-8337-fc090803cca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:44.425099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c2665e7a-608b-4145-8337-fc090803cca7 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:44.426348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c2665e7a-608b-4145-8337-fc090803cca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:44.435164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 696/1397] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:44.495119 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64b1a-b990-4335-8fc7-7e44362c3626 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:44.495317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64b1a-b990-4335-8fc7-7e44362c3626 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:44.495576 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc64b1a-b990-4335-8fc7-7e44362c3626 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:44.497588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 702/1398] 10.222.0.62 () {54 vars in 962 bytes} [Mon Dec 13 16:41:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:44.503856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9c620-c40e-4a4a-b2e5-8185c57bced8 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:44.504114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9c620-c40e-4a4a-b2e5-8185c57bced8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:44.504545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9c620-c40e-4a4a-b2e5-8185c57bced8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:44.554614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-49a9c620-c40e-4a4a-b2e5-8185c57bced8 None None] MFA Rules not processed for user `18f1422ce48e44ab85e6d5e10d1ea898`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:44.555810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-49a9c620-c40e-4a4a-b2e5-8185c57bced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:44.614326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 697/1399] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Dec 13 16:41:44 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:44.622584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64b1a-b990-4335-8fc7-7e44362c3626 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:44.633711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc64b1a-b990-4335-8fc7-7e44362c3626 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:44.637417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746d481-d7b6-4c12-a7bc-67fc863582c2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18f1422ce48e44ab85e6d5e10d1ea898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:44.638074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746d481-d7b6-4c12-a7bc-67fc863582c2 service glance] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:44.638348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746d481-d7b6-4c12-a7bc-67fc863582c2 service glance] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:44.638612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746d481-d7b6-4c12-a7bc-67fc863582c2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:44.647755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746d481-d7b6-4c12-a7bc-67fc863582c2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:44.649218 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746d481-d7b6-4c12-a7bc-67fc863582c2 service glance] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:44.658831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 703/1400] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:44.838942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9cf6a-9563-4f87-ac0c-69be9a8e0619 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:44.839235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9cf6a-9563-4f87-ac0c-69be9a8e0619 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:44.839512 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9cf6a-9563-4f87-ac0c-69be9a8e0619 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:44.844602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 698/1401] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:44.847620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b74e5-532f-4486-9225-0ba202962112 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:44.848851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b74e5-532f-4486-9225-0ba202962112 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:44.849336 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066b74e5-532f-4486-9225-0ba202962112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:44.868188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-066b74e5-532f-4486-9225-0ba202962112 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:44.869466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-066b74e5-532f-4486-9225-0ba202962112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:44.882186 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 704/1402] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:44.928409 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9cf6a-9563-4f87-ac0c-69be9a8e0619 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:44.943621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9cf6a-9563-4f87-ac0c-69be9a8e0619 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:44.950932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83046c09-fa08-483d-be97-22c0c666492d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:44.951665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83046c09-fa08-483d-be97-22c0c666492d service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:44.951942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83046c09-fa08-483d-be97-22c0c666492d service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:44.952210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83046c09-fa08-483d-be97-22c0c666492d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:44.960894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83046c09-fa08-483d-be97-22c0c666492d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:44.962539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83046c09-fa08-483d-be97-22c0c666492d service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:44.971823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 699/1403] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:45.103252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21c144-86a6-477e-9c1b-cbdac2e44e94 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:45.103602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21c144-86a6-477e-9c1b-cbdac2e44e94 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:45.103960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21c144-86a6-477e-9c1b-cbdac2e44e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:45.157636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-bf21c144-86a6-477e-9c1b-cbdac2e44e94 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:45.158857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bf21c144-86a6-477e-9c1b-cbdac2e44e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:45.230170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 705/1404] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:41:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:45.273521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf503e4-8a18-4d71-8f28-a30b482c5afd None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:45.273891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf503e4-8a18-4d71-8f28-a30b482c5afd None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:45.274233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf503e4-8a18-4d71-8f28-a30b482c5afd None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:45.276302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 700/1405] 10.222.0.62 () {54 vars in 942 bytes} [Mon Dec 13 16:41:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:45.283456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919648-bf8d-4a14-9f86-4555c9f01629 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:45.283751 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919648-bf8d-4a14-9f86-4555c9f01629 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:45.284027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20919648-bf8d-4a14-9f86-4555c9f01629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:45.332676 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-20919648-bf8d-4a14-9f86-4555c9f01629 None None] MFA Rules not processed for user `940c2c607c7b4f949593791360f99fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:45.333875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-20919648-bf8d-4a14-9f86-4555c9f01629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:45.404669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 706/1406] 10.222.0.62 () {58 vars in 1039 bytes} [Mon Dec 13 16:41:45 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:45.414197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf503e4-8a18-4d71-8f28-a30b482c5afd None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:45.427758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf503e4-8a18-4d71-8f28-a30b482c5afd None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:45.433051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937635eb-b606-471a-b203-3ab12ee596d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:45.433680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937635eb-b606-471a-b203-3ab12ee596d9 service swift] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:45.433956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937635eb-b606-471a-b203-3ab12ee596d9 service swift] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:45.434224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937635eb-b606-471a-b203-3ab12ee596d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:45.442110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937635eb-b606-471a-b203-3ab12ee596d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:45.443681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937635eb-b606-471a-b203-3ab12ee596d9 service swift] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:45.451729 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 701/1407] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:41:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:41:47.375208 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97171-c7c8-4736-a3d9-dafa69bfb8f5 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:47.376090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97171-c7c8-4736-a3d9-dafa69bfb8f5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:47.376090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac97171-c7c8-4736-a3d9-dafa69bfb8f5 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:47.377898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 707/1408] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:47.383893 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c53982-43d8-479c-b63a-a8a2190877c7 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:47.384349 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c53982-43d8-479c-b63a-a8a2190877c7 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:47.384442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c53982-43d8-479c-b63a-a8a2190877c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:47.402460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-38c53982-43d8-479c-b63a-a8a2190877c7 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:47.404513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-38c53982-43d8-479c-b63a-a8a2190877c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:47.415605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 702/1409] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:47.461678 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac97171-c7c8-4736-a3d9-dafa69bfb8f5 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:47.478237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac97171-c7c8-4736-a3d9-dafa69bfb8f5 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:47.483757 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885cac2-e822-4613-8d67-1ad25f3b76fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:47.484671 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885cac2-e822-4613-8d67-1ad25f3b76fd service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:47.485025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885cac2-e822-4613-8d67-1ad25f3b76fd service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:47.485373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885cac2-e822-4613-8d67-1ad25f3b76fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:47.495521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885cac2-e822-4613-8d67-1ad25f3b76fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:47.497397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885cac2-e822-4613-8d67-1ad25f3b76fd service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:47.509749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 708/1410] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:41:50.007513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfb8f3-a2a6-4b87-92a7-5ac96bcde3f4 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:50.008103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfb8f3-a2a6-4b87-92a7-5ac96bcde3f4 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:50.008103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfb8f3-a2a6-4b87-92a7-5ac96bcde3f4 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:50.012894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 703/1411] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:41:50 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:41:50.015608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb9bc2-f740-4a14-be86-d0c27fab2c90 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:50.016399 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb9bc2-f740-4a14-be86-d0c27fab2c90 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:50.016711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb9bc2-f740-4a14-be86-d0c27fab2c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:50.035090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-89fb9bc2-f740-4a14-be86-d0c27fab2c90 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:41:50.036298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-89fb9bc2-f740-4a14-be86-d0c27fab2c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:41:50.044318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 709/1412] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:41:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:41:50.091031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfb8f3-a2a6-4b87-92a7-5ac96bcde3f4 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:41:50.108502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfb8f3-a2a6-4b87-92a7-5ac96bcde3f4 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:41:50.114097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4e3d2-0f61-433e-9ce6-237b05a632c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:41:50.114745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4e3d2-0f61-433e-9ce6-237b05a632c3 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:41:50.115021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4e3d2-0f61-433e-9ce6-237b05a632c3 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:41:50.115328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4e3d2-0f61-433e-9ce6-237b05a632c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:41:50.127761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4e3d2-0f61-433e-9ce6-237b05a632c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:41:50.129410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4e3d2-0f61-433e-9ce6-237b05a632c3 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:41:50.138854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 704/1413] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:41:50 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:08.391157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e432-f5f1-4b65-8a23-e133767ad1e3 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:08.391754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e432-f5f1-4b65-8a23-e133767ad1e3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:08.391754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305e432-f5f1-4b65-8a23-e133767ad1e3 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:08.394285 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 710/1414] 10.222.0.62 () {54 vars in 918 bytes} [Mon Dec 13 16:42:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:08.400124 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57713f45-1039-4c96-8ec2-ac8fec1c00c0 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:08.400614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57713f45-1039-4c96-8ec2-ac8fec1c00c0 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:08.400801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57713f45-1039-4c96-8ec2-ac8fec1c00c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:08.420164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-57713f45-1039-4c96-8ec2-ac8fec1c00c0 None None] MFA Rules not processed for user `02b7187c26dd41bea9f3c2b49de8ef28`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:08.421375 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-57713f45-1039-4c96-8ec2-ac8fec1c00c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:08.430455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 705/1415] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Dec 13 16:42:08 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:08.445534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8783-b10d-4409-9c92-a3d0a3e86267 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:08.445820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8783-b10d-4409-9c92-a3d0a3e86267 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:08.446099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee8783-b10d-4409-9c92-a3d0a3e86267 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:08.447882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 711/1416] 10.222.0.62 () {54 vars in 918 bytes} [Mon Dec 13 16:42:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:08.453016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f2454-07bd-47d3-b164-8ab50b6661df None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:08.453306 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f2454-07bd-47d3-b164-8ab50b6661df None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:08.453575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f2454-07bd-47d3-b164-8ab50b6661df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:08.472503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-ac4f2454-07bd-47d3-b164-8ab50b6661df None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:08.473723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ac4f2454-07bd-47d3-b164-8ab50b6661df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:08.484226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 706/1417] 10.222.0.62 () {58 vars in 1015 bytes} [Mon Dec 13 16:42:08 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:11.284231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5becc-7b2b-4d90-bc4f-5ca730b42c29 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:11.285256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5becc-7b2b-4d90-bc4f-5ca730b42c29 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:11.285256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5becc-7b2b-4d90-bc4f-5ca730b42c29 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:11.287881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 712/1418] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:42:11 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:11.296180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda099bb-76dc-4afa-9870-d30232855b7f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:11.296663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda099bb-76dc-4afa-9870-d30232855b7f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:11.296777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda099bb-76dc-4afa-9870-d30232855b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:11.316009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-cda099bb-76dc-4afa-9870-d30232855b7f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:11.317217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-cda099bb-76dc-4afa-9870-d30232855b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:11.325945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 707/1419] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:42:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:11.370371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5becc-7b2b-4d90-bc4f-5ca730b42c29 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:11.392468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5becc-7b2b-4d90-bc4f-5ca730b42c29 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:11.398587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41ca3e-9bfe-4e0b-96b3-45b5ebc8f10e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:11.399250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41ca3e-9bfe-4e0b-96b3-45b5ebc8f10e service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:11.399504 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41ca3e-9bfe-4e0b-96b3-45b5ebc8f10e service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:11.399774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41ca3e-9bfe-4e0b-96b3-45b5ebc8f10e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:11.408445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41ca3e-9bfe-4e0b-96b3-45b5ebc8f10e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:11.410068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41ca3e-9bfe-4e0b-96b3-45b5ebc8f10e service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:11.419981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 713/1420] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:13.009225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b169b-0c0d-415e-907a-434463f4cb6e None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:13.010101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b169b-0c0d-415e-907a-434463f4cb6e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:13.010101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b169b-0c0d-415e-907a-434463f4cb6e None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:13.012847 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 708/1421] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:42:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:13.018558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b18e8-bb7d-47b4-9cd1-c23dc0ba4acd None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:13.019049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b18e8-bb7d-47b4-9cd1-c23dc0ba4acd None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:13.019160 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b18e8-bb7d-47b4-9cd1-c23dc0ba4acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:13.038057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a68b18e8-bb7d-47b4-9cd1-c23dc0ba4acd None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:13.039243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a68b18e8-bb7d-47b4-9cd1-c23dc0ba4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:13.048089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 714/1422] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:42:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:13.206639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b169b-0c0d-415e-907a-434463f4cb6e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:13.225522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b169b-0c0d-415e-907a-434463f4cb6e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:13.232414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d8d31-8028-4120-aaf8-b78f06ca4c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:13.233088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8d31-8028-4120-aaf8-b78f06ca4c79 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:13.233363 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8d31-8028-4120-aaf8-b78f06ca4c79 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:13.233628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d8d31-8028-4120-aaf8-b78f06ca4c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:13.242168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d8d31-8028-4120-aaf8-b78f06ca4c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:13.243775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d8d31-8028-4120-aaf8-b78f06ca4c79 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:13.254312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 709/1423] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:14.819537 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574587d9-e4f3-4008-88d0-bc1a4784b849 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:14.820187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574587d9-e4f3-4008-88d0-bc1a4784b849 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:14.820187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574587d9-e4f3-4008-88d0-bc1a4784b849 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:14.821875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 715/1424] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:42:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:14.828402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b494d0-847b-4b81-8145-f463092c81ef None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:14.828888 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b494d0-847b-4b81-8145-f463092c81ef None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:14.828999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b494d0-847b-4b81-8145-f463092c81ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:14.852785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-b8b494d0-847b-4b81-8145-f463092c81ef None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:14.853965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b8b494d0-847b-4b81-8145-f463092c81ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:14.862885 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 710/1425] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:42:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:15.020806 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574587d9-e4f3-4008-88d0-bc1a4784b849 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:15.045009 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574587d9-e4f3-4008-88d0-bc1a4784b849 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:15.051290 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c5b2-5153-4e69-bc30-4b2cc2750882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:15.051934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c5b2-5153-4e69-bc30-4b2cc2750882 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:15.052216 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c5b2-5153-4e69-bc30-4b2cc2750882 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:15.052490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c5b2-5153-4e69-bc30-4b2cc2750882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:15.062448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c5b2-5153-4e69-bc30-4b2cc2750882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:15.064035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c5b2-5153-4e69-bc30-4b2cc2750882 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:15.074232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 716/1426] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:16.587008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bafb3b-844c-4e35-9d90-39664db20132 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:16.587848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bafb3b-844c-4e35-9d90-39664db20132 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:16.587848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bafb3b-844c-4e35-9d90-39664db20132 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:16.591009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 711/1427] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:42:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:16.600274 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567e29-6613-4747-9a73-4466f4a76d0e None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:16.600792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567e29-6613-4747-9a73-4466f4a76d0e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:16.600888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a567e29-6613-4747-9a73-4466f4a76d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:16.623282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9a567e29-6613-4747-9a73-4466f4a76d0e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:16.624496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9a567e29-6613-4747-9a73-4466f4a76d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:16.633713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 717/1428] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:42:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:16.802466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bafb3b-844c-4e35-9d90-39664db20132 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:16.821329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bafb3b-844c-4e35-9d90-39664db20132 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:16.827842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a68423-bec3-463d-ae4a-486fee1c8631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:16.828484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68423-bec3-463d-ae4a-486fee1c8631 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:16.828798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68423-bec3-463d-ae4a-486fee1c8631 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:16.829088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a68423-bec3-463d-ae4a-486fee1c8631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:16.838047 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a68423-bec3-463d-ae4a-486fee1c8631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:16.839586 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a68423-bec3-463d-ae4a-486fee1c8631 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:16.849713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 712/1429] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:18.399074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c4b33-4d92-476b-bfdd-5649a0f2e3aa None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:18.399959 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c4b33-4d92-476b-bfdd-5649a0f2e3aa None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:18.399959 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c4b33-4d92-476b-bfdd-5649a0f2e3aa None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:18.403064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 718/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:42:18 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:18.409810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6a210-e854-43f0-8770-135443a6192e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:18.410230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6a210-e854-43f0-8770-135443a6192e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:18.410453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6a210-e854-43f0-8770-135443a6192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:18.433492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-6bf6a210-e854-43f0-8770-135443a6192e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:18.434710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6bf6a210-e854-43f0-8770-135443a6192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:18.442891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 713/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:42:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:18.599741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c4b33-4d92-476b-bfdd-5649a0f2e3aa None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:18.626821 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c4b33-4d92-476b-bfdd-5649a0f2e3aa None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:18.637287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64427d2f-bba5-434e-9f75-16abab1df6d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:18.638294 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64427d2f-bba5-434e-9f75-16abab1df6d0 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:18.638629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64427d2f-bba5-434e-9f75-16abab1df6d0 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:18.638981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64427d2f-bba5-434e-9f75-16abab1df6d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:18.652616 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64427d2f-bba5-434e-9f75-16abab1df6d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:18.654405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64427d2f-bba5-434e-9f75-16abab1df6d0 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:18.663946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 719/1432] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:20.114158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693440b3-a0ae-411a-825b-46998bd325ee None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:20.114785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693440b3-a0ae-411a-825b-46998bd325ee None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:20.114785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693440b3-a0ae-411a-825b-46998bd325ee None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:20.116515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 714/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:42:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:20.122774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a5c8b-bec0-418c-a05c-78811cfea366 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:20.123211 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a5c8b-bec0-418c-a05c-78811cfea366 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:20.123323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a5c8b-bec0-418c-a05c-78811cfea366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:20.144010 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7f0a5c8b-bec0-418c-a05c-78811cfea366 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:20.145269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7f0a5c8b-bec0-418c-a05c-78811cfea366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:20.154875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 720/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:42:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:20.315763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693440b3-a0ae-411a-825b-46998bd325ee None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:20.335167 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693440b3-a0ae-411a-825b-46998bd325ee None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:20.341703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4b7a2-0c11-4a5f-af0d-042dc3101d6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:20.342354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4b7a2-0c11-4a5f-af0d-042dc3101d6b service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:20.342638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4b7a2-0c11-4a5f-af0d-042dc3101d6b service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:20.342907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4b7a2-0c11-4a5f-af0d-042dc3101d6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:20.351218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4b7a2-0c11-4a5f-af0d-042dc3101d6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:20.352898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4b7a2-0c11-4a5f-af0d-042dc3101d6b service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:20.362067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 715/1435] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:21.895522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88588d5e-94ea-4b3b-9667-aef5f4c304f0 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:21.896140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88588d5e-94ea-4b3b-9667-aef5f4c304f0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:21.896140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88588d5e-94ea-4b3b-9667-aef5f4c304f0 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:21.897914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 721/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:42:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:21.904031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa5656-5402-45ca-8a62-1c6eedd15b9f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:21.904504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa5656-5402-45ca-8a62-1c6eedd15b9f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:21.904718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa5656-5402-45ca-8a62-1c6eedd15b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:21.927639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-2faa5656-5402-45ca-8a62-1c6eedd15b9f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:21.928876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2faa5656-5402-45ca-8a62-1c6eedd15b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:21.939087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 716/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:42:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:22.130371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88588d5e-94ea-4b3b-9667-aef5f4c304f0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:22.147944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88588d5e-94ea-4b3b-9667-aef5f4c304f0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:22.158841 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5bd72-e97e-4ec4-951e-f6fc13ee94a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:22.159573 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5bd72-e97e-4ec4-951e-f6fc13ee94a8 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:22.159840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5bd72-e97e-4ec4-951e-f6fc13ee94a8 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:22.160086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5bd72-e97e-4ec4-951e-f6fc13ee94a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:22.174040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5bd72-e97e-4ec4-951e-f6fc13ee94a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:22.176839 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5bd72-e97e-4ec4-951e-f6fc13ee94a8 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:22.189662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 722/1438] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:23.707235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada835e3-736f-4d9a-a84e-aad364602fe4 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:23.707821 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada835e3-736f-4d9a-a84e-aad364602fe4 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:23.707821 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada835e3-736f-4d9a-a84e-aad364602fe4 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:23.710637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 717/1439] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:42:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:23.719306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c05eaa-a5d1-4494-be51-fd865d8fbf17 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:23.719748 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c05eaa-a5d1-4494-be51-fd865d8fbf17 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:23.719880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c05eaa-a5d1-4494-be51-fd865d8fbf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:23.747507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e9c05eaa-a5d1-4494-be51-fd865d8fbf17 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:23.748737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e9c05eaa-a5d1-4494-be51-fd865d8fbf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:23.757887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 723/1440] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:42:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:23.911924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada835e3-736f-4d9a-a84e-aad364602fe4 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:23.927144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada835e3-736f-4d9a-a84e-aad364602fe4 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:23.933277 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975bf870-795c-4665-bb5b-ea051c616605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:23.933912 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bf870-795c-4665-bb5b-ea051c616605 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:23.934181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bf870-795c-4665-bb5b-ea051c616605 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:23.934474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975bf870-795c-4665-bb5b-ea051c616605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:23.942621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975bf870-795c-4665-bb5b-ea051c616605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:23.944197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975bf870-795c-4665-bb5b-ea051c616605 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:23.953355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 718/1441] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:25.435553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54219ce-1ba2-4114-88aa-93065cab79bf None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:25.436170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54219ce-1ba2-4114-88aa-93065cab79bf None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:25.436170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54219ce-1ba2-4114-88aa-93065cab79bf None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:25.438078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 724/1442] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:42:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:25.444952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66059-2037-45e3-8dfe-2b6b02f7fc84 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:25.445718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66059-2037-45e3-8dfe-2b6b02f7fc84 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:25.445873 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab66059-2037-45e3-8dfe-2b6b02f7fc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:25.466698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-fab66059-2037-45e3-8dfe-2b6b02f7fc84 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:25.467885 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fab66059-2037-45e3-8dfe-2b6b02f7fc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:25.476581 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 719/1443] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:42:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:25.643497 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54219ce-1ba2-4114-88aa-93065cab79bf None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:25.665881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54219ce-1ba2-4114-88aa-93065cab79bf None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:25.674345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29316103-69ad-474d-af61-efa39c0994f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:25.675299 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29316103-69ad-474d-af61-efa39c0994f9 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:25.675763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29316103-69ad-474d-af61-efa39c0994f9 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:25.676198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29316103-69ad-474d-af61-efa39c0994f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:25.689895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29316103-69ad-474d-af61-efa39c0994f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:25.692317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29316103-69ad-474d-af61-efa39c0994f9 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:25.705060 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 725/1444] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:27.961513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124ace-7adb-4a64-b577-08bb17ab3c5c None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:27.962376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124ace-7adb-4a64-b577-08bb17ab3c5c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:27.962376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d124ace-7adb-4a64-b577-08bb17ab3c5c None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:27.965379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 720/1445] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:42:27 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:27.971627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f538cfd-2ebb-4c88-92d0-5c149bf12458 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:27.972079 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f538cfd-2ebb-4c88-92d0-5c149bf12458 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:27.972183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f538cfd-2ebb-4c88-92d0-5c149bf12458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:27.991461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-3f538cfd-2ebb-4c88-92d0-5c149bf12458 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:27.992610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3f538cfd-2ebb-4c88-92d0-5c149bf12458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:28.000790 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 726/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:42:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:28.044994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d124ace-7adb-4a64-b577-08bb17ab3c5c None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:28.058616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d124ace-7adb-4a64-b577-08bb17ab3c5c None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:28.063366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bdd48-b8e7-42ef-a9bc-63129ce4970d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:28.064013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bdd48-b8e7-42ef-a9bc-63129ce4970d service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:28.064251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bdd48-b8e7-42ef-a9bc-63129ce4970d service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:28.064548 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bdd48-b8e7-42ef-a9bc-63129ce4970d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:28.074514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bdd48-b8e7-42ef-a9bc-63129ce4970d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:28.076083 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bdd48-b8e7-42ef-a9bc-63129ce4970d service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:28.085465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 721/1447] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:30.580930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa81c6-ed7c-4c4f-b55e-d623a96001cb None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:30.581783 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa81c6-ed7c-4c4f-b55e-d623a96001cb None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:30.581783 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa81c6-ed7c-4c4f-b55e-d623a96001cb None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:30.584538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 727/1448] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:42:30 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:30.591881 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3638-975b-4046-954c-83ece29d3f6e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:30.592321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3638-975b-4046-954c-83ece29d3f6e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:30.592435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a3638-975b-4046-954c-83ece29d3f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:30.613398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-706a3638-975b-4046-954c-83ece29d3f6e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:30.614591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-706a3638-975b-4046-954c-83ece29d3f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:30.625146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 722/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:42:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:30.673006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa81c6-ed7c-4c4f-b55e-d623a96001cb None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:30.686045 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa81c6-ed7c-4c4f-b55e-d623a96001cb None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:30.691134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebbb72-a095-4499-8f68-c4cae45a3c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:30.691773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbb72-a095-4499-8f68-c4cae45a3c9d service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:30.692046 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbb72-a095-4499-8f68-c4cae45a3c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:30.692313 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbb72-a095-4499-8f68-c4cae45a3c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:30.702842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebbb72-a095-4499-8f68-c4cae45a3c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:30.704295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbebbb72-a095-4499-8f68-c4cae45a3c9d service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:30.714136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 728/1450] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:33.427331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2ee4b-7b09-4175-8108-c6792c92ee90 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:33.427945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2ee4b-7b09-4175-8108-c6792c92ee90 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:33.427945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2ee4b-7b09-4175-8108-c6792c92ee90 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:33.429707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 723/1451] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:42:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:33.436901 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db75d5-8cf8-4215-ab12-47e6b9b82745 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:33.437614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db75d5-8cf8-4215-ab12-47e6b9b82745 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:33.437733 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db75d5-8cf8-4215-ab12-47e6b9b82745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:33.466389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-62db75d5-8cf8-4215-ab12-47e6b9b82745 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:33.467593 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-62db75d5-8cf8-4215-ab12-47e6b9b82745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:33.476334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 729/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:42:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:33.528478 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2ee4b-7b09-4175-8108-c6792c92ee90 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:33.541016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2ee4b-7b09-4175-8108-c6792c92ee90 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:33.546799 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f8108-5356-46a4-aeb6-fe447bc6cb5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:33.547721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f8108-5356-46a4-aeb6-fe447bc6cb5a service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:33.548139 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f8108-5356-46a4-aeb6-fe447bc6cb5a service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:33.548543 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f8108-5356-46a4-aeb6-fe447bc6cb5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:33.559219 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f8108-5356-46a4-aeb6-fe447bc6cb5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:33.560760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f8108-5356-46a4-aeb6-fe447bc6cb5a service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:33.570042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 724/1453] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:36.033075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5287-5a0c-4b4f-bdba-e7a4719c96e0 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:36.034021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5287-5a0c-4b4f-bdba-e7a4719c96e0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:36.034021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5287-5a0c-4b4f-bdba-e7a4719c96e0 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:36.037043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 730/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:42:36 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:36.044171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3df93-9729-47f5-92ac-985a88b22197 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:36.045760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3df93-9729-47f5-92ac-985a88b22197 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:36.045760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3df93-9729-47f5-92ac-985a88b22197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:36.064493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d6c3df93-9729-47f5-92ac-985a88b22197 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:36.065706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d6c3df93-9729-47f5-92ac-985a88b22197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:36.074596 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 725/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:42:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:36.117970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5287-5a0c-4b4f-bdba-e7a4719c96e0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:36.130916 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5287-5a0c-4b4f-bdba-e7a4719c96e0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:36.135365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57610f-767f-4650-9c06-a3726b3bcdf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:36.135983 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57610f-767f-4650-9c06-a3726b3bcdf8 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:36.136266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57610f-767f-4650-9c06-a3726b3bcdf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:36.136541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57610f-767f-4650-9c06-a3726b3bcdf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:36.145976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57610f-767f-4650-9c06-a3726b3bcdf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:36.147421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57610f-767f-4650-9c06-a3726b3bcdf8 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:36.156756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 731/1456] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:38.547782 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a67be-afc1-4ab1-9b91-b795c7e904fd None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:38.548600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a67be-afc1-4ab1-9b91-b795c7e904fd None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:38.548600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a67be-afc1-4ab1-9b91-b795c7e904fd None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:38.551342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 726/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:42:38 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:38.557625 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c7357-0cdb-4f89-a486-3b29f1da8ddb None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:38.558078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c7357-0cdb-4f89-a486-3b29f1da8ddb None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:38.558172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c7357-0cdb-4f89-a486-3b29f1da8ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:38.576443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b80c7357-0cdb-4f89-a486-3b29f1da8ddb None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:38.577581 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b80c7357-0cdb-4f89-a486-3b29f1da8ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:38.586241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 732/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:42:38 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:38.626545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a67be-afc1-4ab1-9b91-b795c7e904fd None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:38.644378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a67be-afc1-4ab1-9b91-b795c7e904fd None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:38.651005 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160dd547-0b31-4a7f-96e7-7d765d880d79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:38.651868 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dd547-0b31-4a7f-96e7-7d765d880d79 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:38.652252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dd547-0b31-4a7f-96e7-7d765d880d79 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:38.652616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160dd547-0b31-4a7f-96e7-7d765d880d79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:38.662531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160dd547-0b31-4a7f-96e7-7d765d880d79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:38.663965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160dd547-0b31-4a7f-96e7-7d765d880d79 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:38.673448 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 727/1459] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:41.149972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2fee-8c7b-4bcc-9ab1-31074bd72ce0 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:41.150535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2fee-8c7b-4bcc-9ab1-31074bd72ce0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:41.150535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b2fee-8c7b-4bcc-9ab1-31074bd72ce0 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:41.152215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 733/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:42:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:41.161708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b54d1-b778-486e-af39-cb34b50f8076 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:41.162429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b54d1-b778-486e-af39-cb34b50f8076 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:41.162622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b54d1-b778-486e-af39-cb34b50f8076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:41.183992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-bb2b54d1-b778-486e-af39-cb34b50f8076 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:41.185309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-bb2b54d1-b778-486e-af39-cb34b50f8076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:41.194520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 728/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:42:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:41.234578 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b2fee-8c7b-4bcc-9ab1-31074bd72ce0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:41.253366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b2fee-8c7b-4bcc-9ab1-31074bd72ce0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:41.259245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927ea45-016d-40a8-a8bd-65521596d8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:41.260198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927ea45-016d-40a8-a8bd-65521596d8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:41.260604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927ea45-016d-40a8-a8bd-65521596d8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:41.260986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927ea45-016d-40a8-a8bd-65521596d8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:41.271133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927ea45-016d-40a8-a8bd-65521596d8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:41.272596 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927ea45-016d-40a8-a8bd-65521596d8a9 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:41.282165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 734/1462] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:43.694486 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5d315-ecaf-49de-ad38-2dd6b8014c91 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:43.695065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5d315-ecaf-49de-ad38-2dd6b8014c91 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:43.695065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5d315-ecaf-49de-ad38-2dd6b8014c91 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:43.696864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 729/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:42:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:43.703326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c4770-da17-4f62-8bc1-6d62651f79a3 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:43.703875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c4770-da17-4f62-8bc1-6d62651f79a3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:43.703875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c4770-da17-4f62-8bc1-6d62651f79a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:43.723444 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-493c4770-da17-4f62-8bc1-6d62651f79a3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:43.724612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-493c4770-da17-4f62-8bc1-6d62651f79a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:43.733531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 735/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:42:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:42:43.775393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5d315-ecaf-49de-ad38-2dd6b8014c91 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:43.794067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5d315-ecaf-49de-ad38-2dd6b8014c91 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:43.798854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f800b10-8316-4a54-b8cf-c6ab4d1ea974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:43.799485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f800b10-8316-4a54-b8cf-c6ab4d1ea974 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:43.799741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f800b10-8316-4a54-b8cf-c6ab4d1ea974 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:43.800043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f800b10-8316-4a54-b8cf-c6ab4d1ea974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:43.810370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f800b10-8316-4a54-b8cf-c6ab4d1ea974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:43.811812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f800b10-8316-4a54-b8cf-c6ab4d1ea974 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:43.821215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 730/1465] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:46.228705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8c1b-bdce-4123-b07f-710697c757bf None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:46.229682 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8c1b-bdce-4123-b07f-710697c757bf None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:46.229682 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed8c1b-bdce-4123-b07f-710697c757bf None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:46.232628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 736/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:42:46 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:46.243048 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e968-53cf-4037-be7a-94b6dfcb57e5 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:46.243791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e968-53cf-4037-be7a-94b6dfcb57e5 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:46.243970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86e968-53cf-4037-be7a-94b6dfcb57e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:46.266708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-9b86e968-53cf-4037-be7a-94b6dfcb57e5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:46.267951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9b86e968-53cf-4037-be7a-94b6dfcb57e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:46.277724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 731/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:42:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:42:46.319833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed8c1b-bdce-4123-b07f-710697c757bf None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:46.337760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed8c1b-bdce-4123-b07f-710697c757bf None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:46.343924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8504d-385c-47b9-8482-d55457cf3dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:46.344589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8504d-385c-47b9-8482-d55457cf3dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:46.344887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8504d-385c-47b9-8482-d55457cf3dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:46.345157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8504d-385c-47b9-8482-d55457cf3dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:46.355250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8504d-385c-47b9-8482-d55457cf3dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:46.356747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8504d-385c-47b9-8482-d55457cf3dc2 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:46.366503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 737/1468] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:42:48.745469 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aacb8-2b71-4255-a23f-234023fa1a25 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:48.746098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aacb8-2b71-4255-a23f-234023fa1a25 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:48.746098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aacb8-2b71-4255-a23f-234023fa1a25 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:48.748120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 732/1469] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:42:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:48.755888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc469dd-bb76-47f0-88c0-9a0b9d10bd88 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:48.756671 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc469dd-bb76-47f0-88c0-9a0b9d10bd88 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:48.756870 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc469dd-bb76-47f0-88c0-9a0b9d10bd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:48.784489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-efc469dd-bb76-47f0-88c0-9a0b9d10bd88 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:48.785722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-efc469dd-bb76-47f0-88c0-9a0b9d10bd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:48.797883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 738/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:42:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:48.837317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aacb8-2b71-4255-a23f-234023fa1a25 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:48.856306 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aacb8-2b71-4255-a23f-234023fa1a25 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:48.861193 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a350d6-9e35-4c91-b3cd-430d21866ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:48.861818 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a350d6-9e35-4c91-b3cd-430d21866ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:48.862118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a350d6-9e35-4c91-b3cd-430d21866ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:48.862372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a350d6-9e35-4c91-b3cd-430d21866ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:48.872770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a350d6-9e35-4c91-b3cd-430d21866ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:48.874263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a350d6-9e35-4c91-b3cd-430d21866ae1 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:48.884431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 733/1471] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:42:51.259019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6d981-b2c0-45fe-9112-1e335df9fcff None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:51.259595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6d981-b2c0-45fe-9112-1e335df9fcff None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:51.259595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6d981-b2c0-45fe-9112-1e335df9fcff None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:51.261376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 739/1472] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:42:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:42:51.268465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8402c1-3d2f-4c1f-9a37-b9702f73bbf3 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:51.268955 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8402c1-3d2f-4c1f-9a37-b9702f73bbf3 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:51.269059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8402c1-3d2f-4c1f-9a37-b9702f73bbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:51.298284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7d8402c1-3d2f-4c1f-9a37-b9702f73bbf3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:42:51.299473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7d8402c1-3d2f-4c1f-9a37-b9702f73bbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:42:51.308360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 734/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:42:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:42:51.349136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6d981-b2c0-45fe-9112-1e335df9fcff None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:42:51.362680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6d981-b2c0-45fe-9112-1e335df9fcff None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:42:51.366731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e6e5bd-74b0-4c3b-92f2-6e593d6e98c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:42:51.367365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6e5bd-74b0-4c3b-92f2-6e593d6e98c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:42:51.367645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6e5bd-74b0-4c3b-92f2-6e593d6e98c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:42:51.367917 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e6e5bd-74b0-4c3b-92f2-6e593d6e98c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:42:51.377921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6e5bd-74b0-4c3b-92f2-6e593d6e98c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:42:51.379388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e6e5bd-74b0-4c3b-92f2-6e593d6e98c8 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:42:51.389258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 740/1474] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:42:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:43:08.565942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b6e5b-941b-454c-ab1b-525817a15ba0 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:08.566538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b6e5b-941b-454c-ab1b-525817a15ba0 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:08.566538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b6e5b-941b-454c-ab1b-525817a15ba0 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:08.568828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 735/1475] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:43:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:43:08.575726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74ee0-5ea5-47b0-9d74-4e1a9b208e9a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:08.576642 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74ee0-5ea5-47b0-9d74-4e1a9b208e9a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:08.577032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b74ee0-5ea5-47b0-9d74-4e1a9b208e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:08.600755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b3b74ee0-5ea5-47b0-9d74-4e1a9b208e9a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:43:08.601948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b3b74ee0-5ea5-47b0-9d74-4e1a9b208e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:43:08.610665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 741/1476] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:43:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:43:08.663362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac48834-a63f-477d-a7bf-2abc4576a6af None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:08.663649 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac48834-a63f-477d-a7bf-2abc4576a6af None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:08.663926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac48834-a63f-477d-a7bf-2abc4576a6af None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:08.665718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 736/1477] 10.222.0.62 () {54 vars in 962 bytes} [Mon Dec 13 16:43:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:43:08.672467 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ac9b-a4f6-4beb-b322-a0fe7043edb8 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:08.672906 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ac9b-a4f6-4beb-b322-a0fe7043edb8 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:08.673281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122ac9b-a4f6-4beb-b322-a0fe7043edb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:08.696305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a122ac9b-a4f6-4beb-b322-a0fe7043edb8 None None] MFA Rules not processed for user `18f1422ce48e44ab85e6d5e10d1ea898`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:43:08.697532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a122ac9b-a4f6-4beb-b322-a0fe7043edb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:43:08.705352 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 742/1478] 10.222.0.62 () {58 vars in 1059 bytes} [Mon Dec 13 16:43:08 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:43:08.713790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac48834-a63f-477d-a7bf-2abc4576a6af None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:43:08.726924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac48834-a63f-477d-a7bf-2abc4576a6af None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:43:08.731089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9e8be-7620-4554-8061-42e2c9314dcc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18f1422ce48e44ab85e6d5e10d1ea898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:43:08.731725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e8be-7620-4554-8061-42e2c9314dcc service glance] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:08.731983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e8be-7620-4554-8061-42e2c9314dcc service glance] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:08.732492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e8be-7620-4554-8061-42e2c9314dcc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:08.742201 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9e8be-7620-4554-8061-42e2c9314dcc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:43:08.743630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9e8be-7620-4554-8061-42e2c9314dcc service glance] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:43:08.753431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 737/1479] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:43:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:43:11.196515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48ec26-3a70-466e-b21c-900b1c922f80 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:11.197183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48ec26-3a70-466e-b21c-900b1c922f80 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:11.197183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48ec26-3a70-466e-b21c-900b1c922f80 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:11.199817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 743/1480] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:43:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:43:11.206679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36834f92-6939-4694-9c10-4f6b7389cd66 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:11.207075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36834f92-6939-4694-9c10-4f6b7389cd66 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:11.207221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36834f92-6939-4694-9c10-4f6b7389cd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:11.225766 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-36834f92-6939-4694-9c10-4f6b7389cd66 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:43:11.226938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-36834f92-6939-4694-9c10-4f6b7389cd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:43:11.236040 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 738/1481] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:43:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:43:11.260199 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48ec26-3a70-466e-b21c-900b1c922f80 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:43:11.274741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48ec26-3a70-466e-b21c-900b1c922f80 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:43:11.279880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023abdb1-bb79-4e09-b2d4-c0e538656300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:43:11.280551 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023abdb1-bb79-4e09-b2d4-c0e538656300 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:11.280854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023abdb1-bb79-4e09-b2d4-c0e538656300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:11.281129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023abdb1-bb79-4e09-b2d4-c0e538656300 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:11.281873 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023abdb1-bb79-4e09-b2d4-c0e538656300 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:43:11.283724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023abdb1-bb79-4e09-b2d4-c0e538656300 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:43:11.303979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 744/1482] 10.222.0.62 () {56 vars in 1108 bytes} [Mon Dec 13 16:43:11 2021] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:43:13.682621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc14b04-2dba-4c38-a98f-3be4b87c1ab3 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:13.683414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc14b04-2dba-4c38-a98f-3be4b87c1ab3 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:13.683414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc14b04-2dba-4c38-a98f-3be4b87c1ab3 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:13.686338 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 739/1483] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:43:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:43:13.696492 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1acbb1-38fc-453a-8f6f-becd5b92ff0d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:13.696989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1acbb1-38fc-453a-8f6f-becd5b92ff0d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:13.697177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1acbb1-38fc-453a-8f6f-becd5b92ff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:13.718521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-2a1acbb1-38fc-453a-8f6f-becd5b92ff0d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:43:13.719728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-2a1acbb1-38fc-453a-8f6f-becd5b92ff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:43:13.729730 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 745/1484] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:43:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:43:13.775423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc14b04-2dba-4c38-a98f-3be4b87c1ab3 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:43:13.792516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc14b04-2dba-4c38-a98f-3be4b87c1ab3 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:43:13.799589 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e0a32a-29ea-47d7-b22c-95e6c5dc8446 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:43:13.800249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0a32a-29ea-47d7-b22c-95e6c5dc8446 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:13.800505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0a32a-29ea-47d7-b22c-95e6c5dc8446 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:13.800809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e0a32a-29ea-47d7-b22c-95e6c5dc8446 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:13.810316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0a32a-29ea-47d7-b22c-95e6c5dc8446 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:43:13.811908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e0a32a-29ea-47d7-b22c-95e6c5dc8446 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:43:13.821624 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 740/1485] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:43:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:43:16.367172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2a2e1-34fe-4232-ac64-039ca67eded8 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:16.368065 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2a2e1-34fe-4232-ac64-039ca67eded8 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:16.368065 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2a2e1-34fe-4232-ac64-039ca67eded8 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:16.370745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 746/1486] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:43:16 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:43:16.378012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53012b-5c3b-4387-b983-195f2144021f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:16.378465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53012b-5c3b-4387-b983-195f2144021f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:16.378577 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53012b-5c3b-4387-b983-195f2144021f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:16.398053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-ff53012b-5c3b-4387-b983-195f2144021f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:43:16.399231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ff53012b-5c3b-4387-b983-195f2144021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:43:16.408359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 741/1487] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:43:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:43:16.446512 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2a2e1-34fe-4232-ac64-039ca67eded8 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:43:16.459578 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2a2e1-34fe-4232-ac64-039ca67eded8 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:43:16.463638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f06063-40d3-4720-b328-85cd7f2b6d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:43:16.464276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f06063-40d3-4720-b328-85cd7f2b6d43 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:16.464552 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f06063-40d3-4720-b328-85cd7f2b6d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:16.464868 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f06063-40d3-4720-b328-85cd7f2b6d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:16.474026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f06063-40d3-4720-b328-85cd7f2b6d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:43:16.475469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f06063-40d3-4720-b328-85cd7f2b6d43 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:43:16.485663 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 747/1488] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:43:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:43:18.906798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2e197-ab16-4623-9a08-9b844b34ec10 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:18.907511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2e197-ab16-4623-9a08-9b844b34ec10 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:18.907673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2e197-ab16-4623-9a08-9b844b34ec10 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:18.910516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 742/1489] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:43:18 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:43:18.916245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e87d6-787d-4a8c-9124-cf6f07498979 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:18.916733 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e87d6-787d-4a8c-9124-cf6f07498979 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:18.916838 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e87d6-787d-4a8c-9124-cf6f07498979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:18.935610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-452e87d6-787d-4a8c-9124-cf6f07498979 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:43:18.936924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-452e87d6-787d-4a8c-9124-cf6f07498979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:43:18.946430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 748/1490] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:43:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:43:18.997387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2e197-ab16-4623-9a08-9b844b34ec10 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:43:19.011419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2e197-ab16-4623-9a08-9b844b34ec10 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:43:19.016268 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d41bfa-bae6-4c5f-9776-a1b4f62a56d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:43:19.016953 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d41bfa-bae6-4c5f-9776-a1b4f62a56d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:19.017256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d41bfa-bae6-4c5f-9776-a1b4f62a56d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:19.017528 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d41bfa-bae6-4c5f-9776-a1b4f62a56d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:19.027567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d41bfa-bae6-4c5f-9776-a1b4f62a56d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:43:19.029124 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d41bfa-bae6-4c5f-9776-a1b4f62a56d7 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:43:19.038742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 743/1491] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:43:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:43:21.508445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120df2b-e68b-4ba0-86e2-a96a414573ed None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:21.509366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120df2b-e68b-4ba0-86e2-a96a414573ed None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:21.509797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120df2b-e68b-4ba0-86e2-a96a414573ed None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:21.512651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 749/1492] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:43:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:43:21.521628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e80d-4e95-45fb-94e6-70a38cf34a2c None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:21.522138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e80d-4e95-45fb-94e6-70a38cf34a2c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:21.522138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e80d-4e95-45fb-94e6-70a38cf34a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:21.541474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f553e80d-4e95-45fb-94e6-70a38cf34a2c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:43:21.542659 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f553e80d-4e95-45fb-94e6-70a38cf34a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:43:21.551083 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 744/1493] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:43:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:43:21.595423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120df2b-e68b-4ba0-86e2-a96a414573ed None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:43:21.614132 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120df2b-e68b-4ba0-86e2-a96a414573ed None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:43:21.620538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee9d60-b81e-4809-ad33-f68771a1b40b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:43:21.621515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9d60-b81e-4809-ad33-f68771a1b40b service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:21.621790 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9d60-b81e-4809-ad33-f68771a1b40b service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:21.622062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee9d60-b81e-4809-ad33-f68771a1b40b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:21.632270 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee9d60-b81e-4809-ad33-f68771a1b40b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:43:21.633721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee9d60-b81e-4809-ad33-f68771a1b40b service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:43:21.643362 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 750/1494] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:43:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:43:24.287067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42ae4f-9aad-45a3-a049-324ca0a2b34b None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:24.287674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42ae4f-9aad-45a3-a049-324ca0a2b34b None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:24.287674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42ae4f-9aad-45a3-a049-324ca0a2b34b None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:24.289560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 745/1495] 10.222.0.62 () {54 vars in 926 bytes} [Mon Dec 13 16:43:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:43:24.296510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355e715-75a5-41b1-b66c-7ca7189f166d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:24.297190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355e715-75a5-41b1-b66c-7ca7189f166d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:24.297318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355e715-75a5-41b1-b66c-7ca7189f166d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:24.323203 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-1355e715-75a5-41b1-b66c-7ca7189f166d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:43:24.324403 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1355e715-75a5-41b1-b66c-7ca7189f166d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:43:24.334155 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 751/1496] 10.222.0.62 () {58 vars in 1023 bytes} [Mon Dec 13 16:43:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:43:24.377167 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42ae4f-9aad-45a3-a049-324ca0a2b34b None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:43:24.391197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42ae4f-9aad-45a3-a049-324ca0a2b34b None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:43:24.395494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141edf9b-0bf0-42f8-bae9-4e1860e0a4ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:43:24.396132 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141edf9b-0bf0-42f8-bae9-4e1860e0a4ec service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:43:24.396406 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141edf9b-0bf0-42f8-bae9-4e1860e0a4ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:43:24.396705 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141edf9b-0bf0-42f8-bae9-4e1860e0a4ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:43:24.408816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141edf9b-0bf0-42f8-bae9-4e1860e0a4ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:43:24.410243 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141edf9b-0bf0-42f8-bae9-4e1860e0a4ec service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:43:24.419655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 746/1497] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:43:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:44:43.189245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06422e5-8c46-4936-95d1-d31c13db76c5 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:43.189857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06422e5-8c46-4936-95d1-d31c13db76c5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:43.189857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06422e5-8c46-4936-95d1-d31c13db76c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:43.218638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-f06422e5-8c46-4936-95d1-d31c13db76c5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:44:43.220303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f06422e5-8c46-4936-95d1-d31c13db76c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:44:43.228534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 752/1498] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:44:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:44:43.240798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80001b74-6f7b-47ce-8831-ccc49c6aa925 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:43.241335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80001b74-6f7b-47ce-8831-ccc49c6aa925 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:43.241335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80001b74-6f7b-47ce-8831-ccc49c6aa925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:43.264142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-80001b74-6f7b-47ce-8831-ccc49c6aa925 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:44:43.265360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-80001b74-6f7b-47ce-8831-ccc49c6aa925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:44:43.274696 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 747/1499] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:44:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:44:43.279500 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06422e5-8c46-4936-95d1-d31c13db76c5 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:44:43.289848 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06422e5-8c46-4936-95d1-d31c13db76c5 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:44:43.295642 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bb2c2-5e71-41f7-b479-4500e68719ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:44:43.296324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bb2c2-5e71-41f7-b479-4500e68719ec admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:43.296603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bb2c2-5e71-41f7-b479-4500e68719ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:43.296897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bb2c2-5e71-41f7-b479-4500e68719ec admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:43.297665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bb2c2-5e71-41f7-b479-4500e68719ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:44:43.297952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bb2c2-5e71-41f7-b479-4500e68719ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:44:43.299575 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bb2c2-5e71-41f7-b479-4500e68719ec admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:44:43.311667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 753/1500] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:44:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:44:43.320847 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80001b74-6f7b-47ce-8831-ccc49c6aa925 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:44:43.335513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80001b74-6f7b-47ce-8831-ccc49c6aa925 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:44:43.344986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a843a-6e24-43e9-ba00-3394718ed262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:44:43.345650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a843a-6e24-43e9-ba00-3394718ed262 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:43.345922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a843a-6e24-43e9-ba00-3394718ed262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:43.346196 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a843a-6e24-43e9-ba00-3394718ed262 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:43.346912 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a843a-6e24-43e9-ba00-3394718ed262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:44:43.348845 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a843a-6e24-43e9-ba00-3394718ed262 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:44:43.403718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 748/1501] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:44:43 2021] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:44:43.408541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bb2c2-5e71-41f7-b479-4500e68719ec admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:44:43.419697 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bb2c2-5e71-41f7-b479-4500e68719ec admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:44:43.483376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64668fd4-b052-4689-a31a-e2aa47f94eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:44:43.483977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64668fd4-b052-4689-a31a-e2aa47f94eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:43.484257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64668fd4-b052-4689-a31a-e2aa47f94eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:43.484538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64668fd4-b052-4689-a31a-e2aa47f94eb8 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:43.485507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64668fd4-b052-4689-a31a-e2aa47f94eb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:44:43.487437 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64668fd4-b052-4689-a31a-e2aa47f94eb8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:44:43.510405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 754/1502] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:44:43 2021] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:44:43.515396 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a843a-6e24-43e9-ba00-3394718ed262 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:44:43.531493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a843a-6e24-43e9-ba00-3394718ed262 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:44:43.537268 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b22b20-4434-4539-a361-ed91604b321e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:44:43.537932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22b20-4434-4539-a361-ed91604b321e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:43.538211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22b20-4434-4539-a361-ed91604b321e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:43.538485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b22b20-4434-4539-a361-ed91604b321e admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:43.539234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b22b20-4434-4539-a361-ed91604b321e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:44:43.540999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b22b20-4434-4539-a361-ed91604b321e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:44:43.554334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 749/1503] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:44:43 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:44:43.559899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64668fd4-b052-4689-a31a-e2aa47f94eb8 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:44:43.570313 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64668fd4-b052-4689-a31a-e2aa47f94eb8 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:44:43.575720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b7c71-911b-4585-b28b-b7d735787c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:44:43.576370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7c71-911b-4585-b28b-b7d735787c70 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:43.576682 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7c71-911b-4585-b28b-b7d735787c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:43.576956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7c71-911b-4585-b28b-b7d735787c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:43.577693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b7c71-911b-4585-b28b-b7d735787c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:44:43.579277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b7c71-911b-4585-b28b-b7d735787c70 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:44:43.593767 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 755/1504] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:44:43 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:44:43.598685 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b22b20-4434-4539-a361-ed91604b321e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:44:43.613185 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b22b20-4434-4539-a361-ed91604b321e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:44:43.618894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d5614-5c7a-45c4-88c6-5ce760a33fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:44:43.619842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d5614-5c7a-45c4-88c6-5ce760a33fee admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:43.620126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d5614-5c7a-45c4-88c6-5ce760a33fee admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:43.620401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d5614-5c7a-45c4-88c6-5ce760a33fee admin admin] PATH_INFO: `/v3/projects/bb95cb6a1e39471b88fe6514ca53ac13/users/67bb977609424e3eb25a39c53959403e/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:43.636083 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d5614-5c7a-45c4-88c6-5ce760a33fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb95cb6a1e39471b88fe6514ca53ac13, user_id=67bb977609424e3eb25a39c53959403e, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:44:43.638776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d5614-5c7a-45c4-88c6-5ce760a33fee admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:44:43.656423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 750/1505] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:44:43 2021] PUT /identity/v3/projects/bb95cb6a1e39471b88fe6514ca53ac13/users/67bb977609424e3eb25a39c53959403e/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:44:43.667850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caad20a-c1af-4681-8517-09c2fc0243aa None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:43.668132 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caad20a-c1af-4681-8517-09c2fc0243aa None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:43.668406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caad20a-c1af-4681-8517-09c2fc0243aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:43.694865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-3caad20a-c1af-4681-8517-09c2fc0243aa None None] MFA Rules not processed for user `67bb977609424e3eb25a39c53959403e`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:44:43.696066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3caad20a-c1af-4681-8517-09c2fc0243aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:44:43.758605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 756/1506] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:44:43 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:44:43.771743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d5614-5c7a-45c4-88c6-5ce760a33fee admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:44:43.849264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d5614-5c7a-45c4-88c6-5ce760a33fee admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:44:43.855841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bc022-b8f8-43cc-a8a9-82f9f3c08357 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:44:43.856484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bc022-b8f8-43cc-a8a9-82f9f3c08357 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:43.856805 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bc022-b8f8-43cc-a8a9-82f9f3c08357 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:43.857084 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bc022-b8f8-43cc-a8a9-82f9f3c08357 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:43.865262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bc022-b8f8-43cc-a8a9-82f9f3c08357 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:44:43.866858 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bc022-b8f8-43cc-a8a9-82f9f3c08357 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:44:43.875690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 751/1507] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:44:43 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:44:43.946614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254016b-8fdd-4e31-a843-20c936ad3244 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:43.946916 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254016b-8fdd-4e31-a843-20c936ad3244 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:43.947207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254016b-8fdd-4e31-a843-20c936ad3244 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:43.948973 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 757/1508] 10.222.0.62 () {52 vars in 829 bytes} [Mon Dec 13 16:44:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:44:43.952987 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bc022-b8f8-43cc-a8a9-82f9f3c08357 service nova] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:44:44.019474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bc022-b8f8-43cc-a8a9-82f9f3c08357 service nova] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:44:44.028972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:44:44.030355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:44.030848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:44.031237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] PATH_INFO: `/v3/users/67bb977609424e3eb25a39c53959403e` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:44.033424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bb977609424e3eb25a39c53959403e)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:44:44.034473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:44:44.034473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:44:44.034473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:44:44.035664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:44:44.106051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bb977609424e3eb25a39c53959403e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:44:44.126176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bb977609424e3eb25a39c53959403e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:44:44.137757 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bb977609424e3eb25a39c53959403e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:44:44.154099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bb977609424e3eb25a39c53959403e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:44:44.155281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bb977609424e3eb25a39c53959403e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:44:44.165035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 752/1509] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:44:43 2021] DELETE /identity/v3/users/67bb977609424e3eb25a39c53959403e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:44:44.171795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016b5d9-4282-40c2-8648-867d6d6fc94a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:44.172191 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016b5d9-4282-40c2-8648-867d6d6fc94a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:44.172627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016b5d9-4282-40c2-8648-867d6d6fc94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:44.191218 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e016b5d9-4282-40c2-8648-867d6d6fc94a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:44:44.192396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e016b5d9-4282-40c2-8648-867d6d6fc94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:44:44.253842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 758/1510] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:44:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:44:44.267351 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:44:44.268876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:44:44.328931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fc5c5-a40d-46c8-bf59-7193d15a1735 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:44:44.333488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d9212-59a3-4e65-8bf9-596b3b3de812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:44:44.334141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d9212-59a3-4e65-8bf9-596b3b3de812 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:44.334424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d9212-59a3-4e65-8bf9-596b3b3de812 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:44.334695 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d9212-59a3-4e65-8bf9-596b3b3de812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:44.344499 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d9212-59a3-4e65-8bf9-596b3b3de812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:44:44.346560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d9212-59a3-4e65-8bf9-596b3b3de812 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:44:44.356398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 753/1511] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:44:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:44:44.709807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016b5d9-4282-40c2-8648-867d6d6fc94a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:44:44.711234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e016b5d9-4282-40c2-8648-867d6d6fc94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:44:44.725257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016b5d9-4282-40c2-8648-867d6d6fc94a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:44:44.730830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:44:44.731710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:44:44.731986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:44:44.732256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] PATH_INFO: `/v3/projects/bb95cb6a1e39471b88fe6514ca53ac13` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:44:44.733599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb95cb6a1e39471b88fe6514ca53ac13)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:44:44.734641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:44:44.734641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:44:44.734641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:44:44.735891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:44:44.801438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb95cb6a1e39471b88fe6514ca53ac13', 'request_id': 'req-abe3e2c1-bf26-49b0-9928-8237f21de67e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:44:44.812085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb95cb6a1e39471b88fe6514ca53ac13', 'request_id': 'req-abe3e2c1-bf26-49b0-9928-8237f21de67e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:44:44.825784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb95cb6a1e39471b88fe6514ca53ac13', 'request_id': 'req-abe3e2c1-bf26-49b0-9928-8237f21de67e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:44:44.837320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] The token cache is being invalidate because project bb95cb6a1e39471b88fe6514ca53ac13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:44:44.837599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:44:44.838291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-abe3e2c1-bf26-49b0-9928-8237f21de67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:44:44.839965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 759/1512] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:44:44 2021] DELETE /identity/v3/projects/bb95cb6a1e39471b88fe6514ca53ac13 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:46:12.724104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d5339-1763-4a92-9908-8ec9a4b3c952 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:12.724754 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d5339-1763-4a92-9908-8ec9a4b3c952 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:12.724754 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d5339-1763-4a92-9908-8ec9a4b3c952 None None] PATH_INFO: `/v3` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:12.726004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 754/1513] 10.222.0.65 () {54 vars in 925 bytes} [Mon Dec 13 16:46:12 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:46:12.733233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805304-922a-4ccc-9c3c-c43b4ff1e9cd None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:12.733662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805304-922a-4ccc-9c3c-c43b4ff1e9cd None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:12.733805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25805304-922a-4ccc-9c3c-c43b4ff1e9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:12.753448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-25805304-922a-4ccc-9c3c-c43b4ff1e9cd None None] MFA Rules not processed for user `02b7187c26dd41bea9f3c2b49de8ef28`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:46:12.754651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-25805304-922a-4ccc-9c3c-c43b4ff1e9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:12.817119 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 760/1514] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Dec 13 16:46:12 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:46:12.822510 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001248d-2ae0-4442-9495-1066004f43d6 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:12.822818 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001248d-2ae0-4442-9495-1066004f43d6 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:12.823093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001248d-2ae0-4442-9495-1066004f43d6 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:12.825255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 755/1515] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:46:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:46:12.832333 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed489b7-2135-445e-b62c-729b21de3676 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:12.832716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed489b7-2135-445e-b62c-729b21de3676 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:12.832986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed489b7-2135-445e-b62c-729b21de3676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:12.851338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-0ed489b7-2135-445e-b62c-729b21de3676 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:46:12.852599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0ed489b7-2135-445e-b62c-729b21de3676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:12.918175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 761/1516] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:46:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:46:13.078727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001248d-2ae0-4442-9495-1066004f43d6 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:46:13.081269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8001248d-2ae0-4442-9495-1066004f43d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:13.166614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001248d-2ae0-4442-9495-1066004f43d6 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:46:13.172997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295be7a0-f0ea-42e6-b8ab-4c6be2e70234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:46:13.173691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295be7a0-f0ea-42e6-b8ab-4c6be2e70234 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:13.173956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295be7a0-f0ea-42e6-b8ab-4c6be2e70234 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:13.174224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295be7a0-f0ea-42e6-b8ab-4c6be2e70234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:13.183170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295be7a0-f0ea-42e6-b8ab-4c6be2e70234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:46:13.184798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295be7a0-f0ea-42e6-b8ab-4c6be2e70234 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:46:13.194330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 756/1517] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:46:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:46:14.720684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8a53-2543-4606-8734-b680111605cf None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:14.721454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8a53-2543-4606-8734-b680111605cf None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:14.721454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe8a53-2543-4606-8734-b680111605cf None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:14.723032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 762/1518] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:46:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:46:14.729372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed02ce-10f7-41ad-908e-234c050b442a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:14.730102 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed02ce-10f7-41ad-908e-234c050b442a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:14.730256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed02ce-10f7-41ad-908e-234c050b442a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:14.757324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-b4ed02ce-10f7-41ad-908e-234c050b442a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:46:14.758509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b4ed02ce-10f7-41ad-908e-234c050b442a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:14.768925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 757/1519] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:46:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:46:14.926688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe8a53-2543-4606-8734-b680111605cf None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:46:14.942729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe8a53-2543-4606-8734-b680111605cf None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:46:14.948616 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b92e4d-e64b-4b6f-8c24-24bac938b919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:46:14.949276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92e4d-e64b-4b6f-8c24-24bac938b919 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:14.949568 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92e4d-e64b-4b6f-8c24-24bac938b919 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:14.949836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b92e4d-e64b-4b6f-8c24-24bac938b919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:14.959758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b92e4d-e64b-4b6f-8c24-24bac938b919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:46:14.961751 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b92e4d-e64b-4b6f-8c24-24bac938b919 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:46:14.973099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 763/1520] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:46:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:46:16.551225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce0203-5ad2-4224-85ec-3e895d36e812 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:16.551989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce0203-5ad2-4224-85ec-3e895d36e812 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:16.552092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce0203-5ad2-4224-85ec-3e895d36e812 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:16.554250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 758/1521] 10.222.0.62 () {54 vars in 960 bytes} [Mon Dec 13 16:46:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:46:16.560610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f51cf-a702-4129-a567-02d8dc09fa2e None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:16.561180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f51cf-a702-4129-a567-02d8dc09fa2e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:16.561180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f51cf-a702-4129-a567-02d8dc09fa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:16.582687 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7e0f51cf-a702-4129-a567-02d8dc09fa2e None None] MFA Rules not processed for user `02b7187c26dd41bea9f3c2b49de8ef28`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:46:16.584082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7e0f51cf-a702-4129-a567-02d8dc09fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:16.593362 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 764/1522] 10.222.0.62 () {58 vars in 1057 bytes} [Mon Dec 13 16:46:16 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:46:16.601655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce0203-5ad2-4224-85ec-3e895d36e812 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:46:16.616726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce0203-5ad2-4224-85ec-3e895d36e812 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:46:16.622606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07734736-7c75-4309-ab43-2fa4f218fc1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b7187c26dd41bea9f3c2b49de8ef28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:46:16.623267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734736-7c75-4309-ab43-2fa4f218fc1b service placement] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:16.623541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734736-7c75-4309-ab43-2fa4f218fc1b service placement] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:16.623813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07734736-7c75-4309-ab43-2fa4f218fc1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:16.633589 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07734736-7c75-4309-ab43-2fa4f218fc1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:46:16.635184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07734736-7c75-4309-ab43-2fa4f218fc1b service placement] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:46:16.644470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 759/1523] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:46:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:46:27.119461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c56d19-02ff-49f1-a0f5-bda8922770b8 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:27.120111 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c56d19-02ff-49f1-a0f5-bda8922770b8 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:27.120111 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c56d19-02ff-49f1-a0f5-bda8922770b8 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:27.122661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 765/1524] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:46:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:46:27.128872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984723-562f-4c88-8072-2d1500a29fb9 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:27.129360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984723-562f-4c88-8072-2d1500a29fb9 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:27.129462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c984723-562f-4c88-8072-2d1500a29fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:27.151013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7c984723-562f-4c88-8072-2d1500a29fb9 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:46:27.152356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7c984723-562f-4c88-8072-2d1500a29fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:27.162959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 760/1525] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:46:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:46:27.322826 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c56d19-02ff-49f1-a0f5-bda8922770b8 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:46:27.342073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c56d19-02ff-49f1-a0f5-bda8922770b8 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:46:27.348221 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e98c5-a608-45fc-903f-54546c449bcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:46:27.348920 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e98c5-a608-45fc-903f-54546c449bcd service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:27.349194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e98c5-a608-45fc-903f-54546c449bcd service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:27.349458 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e98c5-a608-45fc-903f-54546c449bcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:27.358622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e98c5-a608-45fc-903f-54546c449bcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:46:27.360257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e98c5-a608-45fc-903f-54546c449bcd service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:46:27.371700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 766/1526] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:46:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:46:28.913463 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354812-67bc-4e4c-8f58-f9a7ddf636f8 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:28.914053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354812-67bc-4e4c-8f58-f9a7ddf636f8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:28.914053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354812-67bc-4e4c-8f58-f9a7ddf636f8 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:28.915889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 761/1527] 127.0.0.1 () {54 vars in 901 bytes} [Mon Dec 13 16:46:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:46:28.928287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2795-2a1f-4e48-9278-6bd0f0a99289 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:28.928906 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2795-2a1f-4e48-9278-6bd0f0a99289 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:28.928906 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2795-2a1f-4e48-9278-6bd0f0a99289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:28.949923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-741c2795-2a1f-4e48-9278-6bd0f0a99289 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:46:28.952049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-741c2795-2a1f-4e48-9278-6bd0f0a99289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:28.965303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 767/1528] 127.0.0.1 () {58 vars in 998 bytes} [Mon Dec 13 16:46:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:46:29.132832 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354812-67bc-4e4c-8f58-f9a7ddf636f8 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:46:29.151800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354812-67bc-4e4c-8f58-f9a7ddf636f8 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:46:29.158617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d552c0-2b6e-4d53-98cc-ff1356c47193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:46:29.159274 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d552c0-2b6e-4d53-98cc-ff1356c47193 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:29.159558 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d552c0-2b6e-4d53-98cc-ff1356c47193 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:29.159833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d552c0-2b6e-4d53-98cc-ff1356c47193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:29.175291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d552c0-2b6e-4d53-98cc-ff1356c47193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:46:29.177445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d552c0-2b6e-4d53-98cc-ff1356c47193 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:46:29.190184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 762/1529] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:46:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:46:33.596163 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821716fd-faa4-4ead-a5f4-258c410b39b2 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:33.596745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821716fd-faa4-4ead-a5f4-258c410b39b2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:33.596745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821716fd-faa4-4ead-a5f4-258c410b39b2 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:33.598451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 768/1530] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:46:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:46:33.604496 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26dbd-b32c-41bc-893c-568f7c76ed96 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:33.605192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26dbd-b32c-41bc-893c-568f7c76ed96 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:33.605192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a26dbd-b32c-41bc-893c-568f7c76ed96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:33.629057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f5a26dbd-b32c-41bc-893c-568f7c76ed96 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:46:33.630367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f5a26dbd-b32c-41bc-893c-568f7c76ed96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:33.641206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 763/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:46:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:46:33.682134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821716fd-faa4-4ead-a5f4-258c410b39b2 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:46:33.684394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-821716fd-faa4-4ead-a5f4-258c410b39b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:33.752183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821716fd-faa4-4ead-a5f4-258c410b39b2 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:46:33.756539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04da356-a5d7-4bae-a449-4ceca609762b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:46:33.757245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04da356-a5d7-4bae-a449-4ceca609762b service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:33.757530 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04da356-a5d7-4bae-a449-4ceca609762b service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:33.757790 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04da356-a5d7-4bae-a449-4ceca609762b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:33.768484 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04da356-a5d7-4bae-a449-4ceca609762b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:46:33.769982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04da356-a5d7-4bae-a449-4ceca609762b service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:46:33.780620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 769/1532] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:46:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:46:36.231815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe43d1-12d8-45e2-9f2d-3299feaba854 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:36.232458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe43d1-12d8-45e2-9f2d-3299feaba854 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:36.232458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe43d1-12d8-45e2-9f2d-3299feaba854 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:36.234198 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 764/1533] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:46:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:46:36.240436 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd888-d3a1-4a4e-a8fa-a7144fbf377d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:36.240915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd888-d3a1-4a4e-a8fa-a7144fbf377d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:36.241062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbdd888-d3a1-4a4e-a8fa-a7144fbf377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:36.263244 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-cfbdd888-d3a1-4a4e-a8fa-a7144fbf377d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:46:36.264467 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cfbdd888-d3a1-4a4e-a8fa-a7144fbf377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:36.273758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 770/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:46:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:46:36.312259 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe43d1-12d8-45e2-9f2d-3299feaba854 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:46:36.324026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe43d1-12d8-45e2-9f2d-3299feaba854 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:46:36.327726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3debed-dee6-4e93-a45d-2183252c420e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:46:36.328373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3debed-dee6-4e93-a45d-2183252c420e service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:36.328680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3debed-dee6-4e93-a45d-2183252c420e service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:36.328954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3debed-dee6-4e93-a45d-2183252c420e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:36.339600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3debed-dee6-4e93-a45d-2183252c420e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:46:36.341215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3debed-dee6-4e93-a45d-2183252c420e service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:46:36.351644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 765/1535] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:46:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:46:40.206720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4cc92-5e3b-4c24-97ba-578a2cf1012f None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:40.207348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4cc92-5e3b-4c24-97ba-578a2cf1012f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:40.207348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4cc92-5e3b-4c24-97ba-578a2cf1012f None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:40.209435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 771/1536] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:46:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:46:40.216674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f35d6-0f15-4cdf-b0ee-25aeee890c97 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:40.216674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f35d6-0f15-4cdf-b0ee-25aeee890c97 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:40.217567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f35d6-0f15-4cdf-b0ee-25aeee890c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:40.237644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-a80f35d6-0f15-4cdf-b0ee-25aeee890c97 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:46:40.245169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a80f35d6-0f15-4cdf-b0ee-25aeee890c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:40.255510 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 766/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:46:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:46:40.311402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4cc92-5e3b-4c24-97ba-578a2cf1012f None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:46:40.313338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-09a4cc92-5e3b-4c24-97ba-578a2cf1012f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:40.379033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4cc92-5e3b-4c24-97ba-578a2cf1012f None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:46:40.384099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941d015-fdb6-4db6-b72e-46963ee41331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:46:40.384798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941d015-fdb6-4db6-b72e-46963ee41331 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:40.385085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941d015-fdb6-4db6-b72e-46963ee41331 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:40.385386 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941d015-fdb6-4db6-b72e-46963ee41331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:40.396429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941d015-fdb6-4db6-b72e-46963ee41331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:46:40.398392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941d015-fdb6-4db6-b72e-46963ee41331 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:46:40.411908 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 772/1538] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:46:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:46:42.946327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a85097-f9c7-4a4d-abcc-bff06adde064 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:42.947145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a85097-f9c7-4a4d-abcc-bff06adde064 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:42.947145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a85097-f9c7-4a4d-abcc-bff06adde064 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:42.948943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 767/1539] 127.0.0.1 () {54 vars in 916 bytes} [Mon Dec 13 16:46:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:46:42.957903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59d6d-4a01-4a75-a2bc-a1162e829d11 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:42.958449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59d6d-4a01-4a75-a2bc-a1162e829d11 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:42.958449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59d6d-4a01-4a75-a2bc-a1162e829d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:42.978584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-84e59d6d-4a01-4a75-a2bc-a1162e829d11 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:46:42.981267 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-84e59d6d-4a01-4a75-a2bc-a1162e829d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:42.990511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 773/1540] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Dec 13 16:46:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:46:43.043397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409eca9-6432-4137-b3ea-c9c8b2db10e5 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:43.043668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409eca9-6432-4137-b3ea-c9c8b2db10e5 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:43.043947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409eca9-6432-4137-b3ea-c9c8b2db10e5 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:43.045809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 768/1541] 10.222.0.62 () {54 vars in 963 bytes} [Mon Dec 13 16:46:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:46:43.053318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bbefa-4c5d-4e96-96af-9c702637759a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:43.053814 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bbefa-4c5d-4e96-96af-9c702637759a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:43.054222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bbefa-4c5d-4e96-96af-9c702637759a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:43.076190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-4c5bbefa-4c5d-4e96-96af-9c702637759a None None] MFA Rules not processed for user `20f42eb51a824f69a6f77c5044300da2`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:46:43.077432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4c5bbefa-4c5d-4e96-96af-9c702637759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:46:43.084123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 774/1542] 10.222.0.62 () {58 vars in 1060 bytes} [Mon Dec 13 16:46:43 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:46:43.094250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409eca9-6432-4137-b3ea-c9c8b2db10e5 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:46:43.105595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409eca9-6432-4137-b3ea-c9c8b2db10e5 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:46:43.110191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acce47d-494e-47e8-807e-3d2175c8e0f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:46:43.111106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acce47d-494e-47e8-807e-3d2175c8e0f3 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:46:43.111414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acce47d-494e-47e8-807e-3d2175c8e0f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:46:43.111750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acce47d-494e-47e8-807e-3d2175c8e0f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:46:43.123816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acce47d-494e-47e8-807e-3d2175c8e0f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:46:43.125313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acce47d-494e-47e8-807e-3d2175c8e0f3 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:46:43.139993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 769/1543] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:46:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:05.907246 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee2942-7fb7-43db-9f3b-916e699b610b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:05.908488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee2942-7fb7-43db-9f3b-916e699b610b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:05.908488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee2942-7fb7-43db-9f3b-916e699b610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:05.936314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-bcee2942-7fb7-43db-9f3b-916e699b610b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:05.937566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bcee2942-7fb7-43db-9f3b-916e699b610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:05.943948 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c1caa-275c-4a50-a689-3883b750f90d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:05.945283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c1caa-275c-4a50-a689-3883b750f90d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:05.945283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c1caa-275c-4a50-a689-3883b750f90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:05.955335 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 775/1544] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:05.965751 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc88b93-b25d-42e6-b579-65cd51001855 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:05.966229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc88b93-b25d-42e6-b579-65cd51001855 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:05.966625 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc88b93-b25d-42e6-b579-65cd51001855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:05.984597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-b16c1caa-275c-4a50-a689-3883b750f90d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:05.988191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b16c1caa-275c-4a50-a689-3883b750f90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.002046 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 770/1545] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.007049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-dcc88b93-b25d-42e6-b579-65cd51001855 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.008398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-dcc88b93-b25d-42e6-b579-65cd51001855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.013191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcf6b7-2537-42ec-b771-1a8368a300d7 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.013791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcf6b7-2537-42ec-b771-1a8368a300d7 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.014284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcf6b7-2537-42ec-b771-1a8368a300d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.038042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 776/1546] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:48:06.045637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc88b93-b25d-42e6-b579-65cd51001855 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.048064 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-66bcf6b7-2537-42ec-b771-1a8368a300d7 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.049803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-66bcf6b7-2537-42ec-b771-1a8368a300d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.067428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc88b93-b25d-42e6-b579-65cd51001855 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.074919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 771/1547] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:48:06.080647 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcf6b7-2537-42ec-b771-1a8368a300d7 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.089521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16985d8-db19-48be-8d96-e19285b53f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.090723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16985d8-db19-48be-8d96-e19285b53f8c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.090723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16985d8-db19-48be-8d96-e19285b53f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.090723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16985d8-db19-48be-8d96-e19285b53f8c admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.091758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16985d8-db19-48be-8d96-e19285b53f8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:06.091758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16985d8-db19-48be-8d96-e19285b53f8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.093610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16985d8-db19-48be-8d96-e19285b53f8c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.096371 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcf6b7-2537-42ec-b771-1a8368a300d7 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.113938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c4057-5a59-41b2-8053-3350b9912e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.115005 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c4057-5a59-41b2-8053-3350b9912e9a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.115282 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c4057-5a59-41b2-8053-3350b9912e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.115558 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c4057-5a59-41b2-8053-3350b9912e9a admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.116321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c4057-5a59-41b2-8053-3350b9912e9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:06.116662 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c4057-5a59-41b2-8053-3350b9912e9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.118310 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c4057-5a59-41b2-8053-3350b9912e9a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.129179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 777/1548] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:06.147601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 772/1549] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:48:06.149036 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16985d8-db19-48be-8d96-e19285b53f8c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.157850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c4057-5a59-41b2-8053-3350b9912e9a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.170823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16985d8-db19-48be-8d96-e19285b53f8c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.173815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c4057-5a59-41b2-8053-3350b9912e9a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.183427 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454895b9-0309-457f-a023-9a66f23d0120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.184168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454895b9-0309-457f-a023-9a66f23d0120 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.184454 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454895b9-0309-457f-a023-9a66f23d0120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.185299 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454895b9-0309-457f-a023-9a66f23d0120 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.185527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454895b9-0309-457f-a023-9a66f23d0120 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.186371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be06d8-6973-4a05-aa31-8e78934628ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.187048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be06d8-6973-4a05-aa31-8e78934628ca admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.187328 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be06d8-6973-4a05-aa31-8e78934628ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.187600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be06d8-6973-4a05-aa31-8e78934628ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.187785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454895b9-0309-457f-a023-9a66f23d0120 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.189158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be06d8-6973-4a05-aa31-8e78934628ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.191444 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be06d8-6973-4a05-aa31-8e78934628ca admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.259833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 778/1551] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/projects => generated 367 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:06.260083 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 773/1551] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:48:06.261680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8223-d5a5-4492-b300-1af926478369 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.261972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8223-d5a5-4492-b300-1af926478369 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.262205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bc8223-d5a5-4492-b300-1af926478369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.267719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be06d8-6973-4a05-aa31-8e78934628ca admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.316433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-21bc8223-d5a5-4492-b300-1af926478369 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.318080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-21bc8223-d5a5-4492-b300-1af926478369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.373228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be06d8-6973-4a05-aa31-8e78934628ca admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.402293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 774/1552] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.402838 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8223-d5a5-4492-b300-1af926478369 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.413139 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bc8223-d5a5-4492-b300-1af926478369 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.418518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890714d1-ad67-4180-bc4e-c06f5c46a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.419364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890714d1-ad67-4180-bc4e-c06f5c46a3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.419656 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890714d1-ad67-4180-bc4e-c06f5c46a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.419937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890714d1-ad67-4180-bc4e-c06f5c46a3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.420762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890714d1-ad67-4180-bc4e-c06f5c46a3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.422902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890714d1-ad67-4180-bc4e-c06f5c46a3c8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.449761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80126cba-2167-4374-bb11-5c7300a02011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.450474 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80126cba-2167-4374-bb11-5c7300a02011 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.450758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80126cba-2167-4374-bb11-5c7300a02011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.451033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80126cba-2167-4374-bb11-5c7300a02011 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.451443 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 775/1553] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/users => generated 284 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:06.451751 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80126cba-2167-4374-bb11-5c7300a02011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.453339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65e34-76cf-46b1-9526-ade5263daaf3 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.453603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65e34-76cf-46b1-9526-ade5263daaf3 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.453829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80126cba-2167-4374-bb11-5c7300a02011 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.453998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a65e34-76cf-46b1-9526-ade5263daaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.474609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d2a65e34-76cf-46b1-9526-ade5263daaf3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.475856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d2a65e34-76cf-46b1-9526-ade5263daaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.478231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 779/1554] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/users => generated 302 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:06.479634 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b7b39-4208-4db2-83f3-43b8c4dd0c4d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.479966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b7b39-4208-4db2-83f3-43b8c4dd0c4d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.480177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b7b39-4208-4db2-83f3-43b8c4dd0c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.488099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 776/1555] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.489954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925f79-1d9e-4be0-a21d-8b7fb8fd5db1 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.490241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925f79-1d9e-4be0-a21d-8b7fb8fd5db1 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.490520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b925f79-1d9e-4be0-a21d-8b7fb8fd5db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.501722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-129b7b39-4208-4db2-83f3-43b8c4dd0c4d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.502941 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-129b7b39-4208-4db2-83f3-43b8c4dd0c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.510040 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7b925f79-1d9e-4be0-a21d-8b7fb8fd5db1 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.511231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7b925f79-1d9e-4be0-a21d-8b7fb8fd5db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.516830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 780/1556] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.516830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a6a9e-1dd3-49e9-a418-438495d46796 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.516830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a6a9e-1dd3-49e9-a418-438495d46796 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.516830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a6a9e-1dd3-49e9-a418-438495d46796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.527665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 777/1557] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.529231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095030a-3631-43fe-9f53-4324c80f40c2 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.529520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095030a-3631-43fe-9f53-4324c80f40c2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.529803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095030a-3631-43fe-9f53-4324c80f40c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.544043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-8a3a6a9e-1dd3-49e9-a418-438495d46796 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.545826 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-8a3a6a9e-1dd3-49e9-a418-438495d46796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.551039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-3095030a-3631-43fe-9f53-4324c80f40c2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.552264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-3095030a-3631-43fe-9f53-4324c80f40c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.555352 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 781/1558] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.556670 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0691ad6-c3c4-4f05-96c9-d2c88bf99865 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.557040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0691ad6-c3c4-4f05-96c9-d2c88bf99865 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.557264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0691ad6-c3c4-4f05-96c9-d2c88bf99865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.567764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 778/1559] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.568847 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095030a-3631-43fe-9f53-4324c80f40c2 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.580606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095030a-3631-43fe-9f53-4324c80f40c2 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.583632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-d0691ad6-c3c4-4f05-96c9-d2c88bf99865 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.584973 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d0691ad6-c3c4-4f05-96c9-d2c88bf99865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.586614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212f62-e74a-4efc-b548-d607657a7e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.587293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212f62-e74a-4efc-b548-d607657a7e01 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.587708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212f62-e74a-4efc-b548-d607657a7e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.587982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212f62-e74a-4efc-b548-d607657a7e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.588766 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212f62-e74a-4efc-b548-d607657a7e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.590375 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212f62-e74a-4efc-b548-d607657a7e01 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.593355 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 782/1560] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.594167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0691ad6-c3c4-4f05-96c9-d2c88bf99865 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.605957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0691ad6-c3c4-4f05-96c9-d2c88bf99865 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.606798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 779/1561] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:06.608110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae838b-446d-471e-813f-508850b603cf None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.608393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae838b-446d-471e-813f-508850b603cf None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.608696 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae838b-446d-471e-813f-508850b603cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.614044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d91a8-e5eb-4093-875c-a1fb72c8cf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.614728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d91a8-e5eb-4093-875c-a1fb72c8cf63 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.615007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d91a8-e5eb-4093-875c-a1fb72c8cf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.615278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d91a8-e5eb-4093-875c-a1fb72c8cf63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.616019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d91a8-e5eb-4093-875c-a1fb72c8cf63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.617721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d91a8-e5eb-4093-875c-a1fb72c8cf63 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.630612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 783/1562] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:06.630907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-eeae838b-446d-471e-813f-508850b603cf None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.631074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571fe9-50d2-4be1-8f54-be76a531c87a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.631074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571fe9-50d2-4be1-8f54-be76a531c87a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.631074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e571fe9-50d2-4be1-8f54-be76a531c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.632128 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-eeae838b-446d-471e-813f-508850b603cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.639756 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 780/1563] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.641249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8da4-0ad9-4644-9928-6ef487787150 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.641629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8da4-0ad9-4644-9928-6ef487787150 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.641994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8da4-0ad9-4644-9928-6ef487787150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.650964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-5e571fe9-50d2-4be1-8f54-be76a531c87a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.652226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5e571fe9-50d2-4be1-8f54-be76a531c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.662512 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 784/1564] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.663945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c4d4-cb50-4d5f-82ac-2bdc5a6e1e88 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.664370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c4d4-cb50-4d5f-82ac-2bdc5a6e1e88 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.664712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169c4d4-cb50-4d5f-82ac-2bdc5a6e1e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.668051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-b80e8da4-0ad9-4644-9928-6ef487787150 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.668249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b80e8da4-0ad9-4644-9928-6ef487787150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.682248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 781/1565] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.683398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e8da4-0ad9-4644-9928-6ef487787150 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.685830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7169c4d4-cb50-4d5f-82ac-2bdc5a6e1e88 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.687207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7169c4d4-cb50-4d5f-82ac-2bdc5a6e1e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.695490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 785/1566] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.696129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e8da4-0ad9-4644-9928-6ef487787150 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.696819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260b1d3-e59b-49a2-a4a8-b01f751a0445 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.697103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260b1d3-e59b-49a2-a4a8-b01f751a0445 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.697381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260b1d3-e59b-49a2-a4a8-b01f751a0445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.701364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7c31d-fc69-46c6-a683-1813aafb13d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.702032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7c31d-fc69-46c6-a683-1813aafb13d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.702310 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7c31d-fc69-46c6-a683-1813aafb13d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.702580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7c31d-fc69-46c6-a683-1813aafb13d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.703326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7c31d-fc69-46c6-a683-1813aafb13d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:06.703626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7c31d-fc69-46c6-a683-1813aafb13d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.705276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7c31d-fc69-46c6-a683-1813aafb13d7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.717158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 782/1567] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:06.718055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7c31d-fc69-46c6-a683-1813aafb13d7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.722889 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-4260b1d3-e59b-49a2-a4a8-b01f751a0445 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:06.724077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4260b1d3-e59b-49a2-a4a8-b01f751a0445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:06.730564 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7c31d-fc69-46c6-a683-1813aafb13d7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.734073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 786/1568] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:06.735041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260b1d3-e59b-49a2-a4a8-b01f751a0445 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.738171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c576e-775b-4ee1-a029-4a9fdca1f112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.739151 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c576e-775b-4ee1-a029-4a9fdca1f112 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.739633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c576e-775b-4ee1-a029-4a9fdca1f112 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.740112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c576e-775b-4ee1-a029-4a9fdca1f112 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.741657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c576e-775b-4ee1-a029-4a9fdca1f112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.744783 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260b1d3-e59b-49a2-a4a8-b01f751a0445 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.744912 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c576e-775b-4ee1-a029-4a9fdca1f112 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.749580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf316b8-08a8-4a45-93e5-1ade6c4216f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.750237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf316b8-08a8-4a45-93e5-1ade6c4216f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.750510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf316b8-08a8-4a45-93e5-1ade6c4216f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.750777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf316b8-08a8-4a45-93e5-1ade6c4216f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.751535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf316b8-08a8-4a45-93e5-1ade6c4216f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.753174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf316b8-08a8-4a45-93e5-1ade6c4216f1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.763388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 787/1569] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:06.764359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 783/1570] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:06.765289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf316b8-08a8-4a45-93e5-1ade6c4216f1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.765743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c576e-775b-4ee1-a029-4a9fdca1f112 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.778175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf316b8-08a8-4a45-93e5-1ade6c4216f1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.783215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c576e-775b-4ee1-a029-4a9fdca1f112 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.783976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08cd3c-c56c-4ab8-9bf8-db5cb97236fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.785172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08cd3c-c56c-4ab8-9bf8-db5cb97236fc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.785796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08cd3c-c56c-4ab8-9bf8-db5cb97236fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.785796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08cd3c-c56c-4ab8-9bf8-db5cb97236fc admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.786338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08cd3c-c56c-4ab8-9bf8-db5cb97236fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:06.786640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08cd3c-c56c-4ab8-9bf8-db5cb97236fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.788256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08cd3c-c56c-4ab8-9bf8-db5cb97236fc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.789893 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387e0b6-c055-4edc-b761-db86240d0eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.790674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387e0b6-c055-4edc-b761-db86240d0eba admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.791057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387e0b6-c055-4edc-b761-db86240d0eba admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.791397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387e0b6-c055-4edc-b761-db86240d0eba admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.792208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387e0b6-c055-4edc-b761-db86240d0eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:06.792514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387e0b6-c055-4edc-b761-db86240d0eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.794154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387e0b6-c055-4edc-b761-db86240d0eba admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.802428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 788/1571] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:06.803259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08cd3c-c56c-4ab8-9bf8-db5cb97236fc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.815420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 784/1572] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:06.815420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387e0b6-c055-4edc-b761-db86240d0eba admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.821740 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387e0b6-c055-4edc-b761-db86240d0eba admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.822542 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08cd3c-c56c-4ab8-9bf8-db5cb97236fc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.827324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd98ab-5c15-4ff5-a6c5-64cbc4e7251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.828296 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd98ab-5c15-4ff5-a6c5-64cbc4e7251c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.828527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dc8c4-9d42-4f73-ac3c-5bbeedbc3fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.828702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd98ab-5c15-4ff5-a6c5-64cbc4e7251c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.828849 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd98ab-5c15-4ff5-a6c5-64cbc4e7251c admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.829244 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dc8c4-9d42-4f73-ac3c-5bbeedbc3fdc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.829535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dc8c4-9d42-4f73-ac3c-5bbeedbc3fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.829755 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd98ab-5c15-4ff5-a6c5-64cbc4e7251c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:06.829855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dc8c4-9d42-4f73-ac3c-5bbeedbc3fdc admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.830061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd98ab-5c15-4ff5-a6c5-64cbc4e7251c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.830513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dc8c4-9d42-4f73-ac3c-5bbeedbc3fdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:06.830813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dc8c4-9d42-4f73-ac3c-5bbeedbc3fdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.831800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd98ab-5c15-4ff5-a6c5-64cbc4e7251c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.832403 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dc8c4-9d42-4f73-ac3c-5bbeedbc3fdc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.855377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 789/1573] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:06.855616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 785/1574] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:06.855724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dc8c4-9d42-4f73-ac3c-5bbeedbc3fdc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.855812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd98ab-5c15-4ff5-a6c5-64cbc4e7251c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.855900 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dc8c4-9d42-4f73-ac3c-5bbeedbc3fdc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.860931 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df350577-1dfd-4a72-8df7-6dfc9e702923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.861584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df350577-1dfd-4a72-8df7-6dfc9e702923 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.861871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df350577-1dfd-4a72-8df7-6dfc9e702923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.861991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd98ab-5c15-4ff5-a6c5-64cbc4e7251c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.862185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df350577-1dfd-4a72-8df7-6dfc9e702923 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.862849 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df350577-1dfd-4a72-8df7-6dfc9e702923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.864971 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df350577-1dfd-4a72-8df7-6dfc9e702923 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.867354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e18e6-f8cb-4ec2-a6f1-181afd7a0dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.868006 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e18e6-f8cb-4ec2-a6f1-181afd7a0dcd admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.868504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e18e6-f8cb-4ec2-a6f1-181afd7a0dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.868828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e18e6-f8cb-4ec2-a6f1-181afd7a0dcd admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.869694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e18e6-f8cb-4ec2-a6f1-181afd7a0dcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:06.869995 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e18e6-f8cb-4ec2-a6f1-181afd7a0dcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.872519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e18e6-f8cb-4ec2-a6f1-181afd7a0dcd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.896693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 786/1575] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:06.896693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e18e6-f8cb-4ec2-a6f1-181afd7a0dcd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.901307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 790/1576] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:06 2021] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:06.902527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df350577-1dfd-4a72-8df7-6dfc9e702923 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:06.906172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e18e6-f8cb-4ec2-a6f1-181afd7a0dcd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.968206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d87ab-5a74-490a-8128-1423535a5f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.969234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d87ab-5a74-490a-8128-1423535a5f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.969517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d87ab-5a74-490a-8128-1423535a5f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.969791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d87ab-5a74-490a-8128-1423535a5f0b admin admin] PATH_INFO: `/v3/projects/163dbcd4f38c42c7b86df6d0040185b0/users/956e41eae5f24c328f1cb8a8efffa5c5/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.972532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df350577-1dfd-4a72-8df7-6dfc9e702923 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:06.977836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc5ed5-b41a-40c3-a95c-f2ef320895f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:06.978752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc5ed5-b41a-40c3-a95c-f2ef320895f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:06.979033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc5ed5-b41a-40c3-a95c-f2ef320895f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:06.979299 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc5ed5-b41a-40c3-a95c-f2ef320895f9 admin admin] PATH_INFO: `/v3/projects/eb46152996d44299aef15b7ea8582de2/users/5670565ff02147ec80c0d2cb7fad174b/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:06.987069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d87ab-5a74-490a-8128-1423535a5f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=163dbcd4f38c42c7b86df6d0040185b0, user_id=956e41eae5f24c328f1cb8a8efffa5c5, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.990033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d87ab-5a74-490a-8128-1423535a5f0b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:06.996122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc5ed5-b41a-40c3-a95c-f2ef320895f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb46152996d44299aef15b7ea8582de2, user_id=5670565ff02147ec80c0d2cb7fad174b, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:06.999254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc5ed5-b41a-40c3-a95c-f2ef320895f9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.008361 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 787/1577] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:06 2021] PUT /identity/v3/projects/163dbcd4f38c42c7b86df6d0040185b0/users/956e41eae5f24c328f1cb8a8efffa5c5/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:07.013312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d87ab-5a74-490a-8128-1423535a5f0b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.014525 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 791/1578] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:06 2021] PUT /identity/v3/projects/eb46152996d44299aef15b7ea8582de2/users/5670565ff02147ec80c0d2cb7fad174b/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:07.015395 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc5ed5-b41a-40c3-a95c-f2ef320895f9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.094785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc5ed5-b41a-40c3-a95c-f2ef320895f9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.095842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d87ab-5a74-490a-8128-1423535a5f0b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.099811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5efa37-74a7-413c-ae63-4f1518c27356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.100476 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5efa37-74a7-413c-ae63-4f1518c27356 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.100743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd1049-297f-465f-affa-0db909111af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.100876 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5efa37-74a7-413c-ae63-4f1518c27356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.101117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5efa37-74a7-413c-ae63-4f1518c27356 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.101538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1049-297f-465f-affa-0db909111af8 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.101825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5efa37-74a7-413c-ae63-4f1518c27356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.101931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1049-297f-465f-affa-0db909111af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.102100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd1049-297f-465f-affa-0db909111af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.102805 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd1049-297f-465f-affa-0db909111af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.103763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5efa37-74a7-413c-ae63-4f1518c27356 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.104780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd1049-297f-465f-affa-0db909111af8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.142043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 792/1579] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:07.142278 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 788/1580] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:07.142377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5efa37-74a7-413c-ae63-4f1518c27356 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.142492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd1049-297f-465f-affa-0db909111af8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.204029 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd1049-297f-465f-affa-0db909111af8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.205949 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5efa37-74a7-413c-ae63-4f1518c27356 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.209887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0a1f6-8852-4d54-a4fa-f77b17dc770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.210542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a1f6-8852-4d54-a4fa-f77b17dc770c admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.210826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a1f6-8852-4d54-a4fa-f77b17dc770c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.211102 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0a1f6-8852-4d54-a4fa-f77b17dc770c admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.211828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0a1f6-8852-4d54-a4fa-f77b17dc770c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.212358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015469a-2144-49e3-afea-f3e3d2c8a402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.213057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015469a-2144-49e3-afea-f3e3d2c8a402 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.213057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015469a-2144-49e3-afea-f3e3d2c8a402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.213727 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015469a-2144-49e3-afea-f3e3d2c8a402 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.213969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0a1f6-8852-4d54-a4fa-f77b17dc770c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.214328 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015469a-2144-49e3-afea-f3e3d2c8a402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.216271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015469a-2144-49e3-afea-f3e3d2c8a402 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.246123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 789/1581] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:07.246832 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0a1f6-8852-4d54-a4fa-f77b17dc770c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.251133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 793/1582] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:07.252262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015469a-2144-49e3-afea-f3e3d2c8a402 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.318595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0a1f6-8852-4d54-a4fa-f77b17dc770c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.319883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015469a-2144-49e3-afea-f3e3d2c8a402 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.325575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b819a7-300e-4cb5-b542-b170a67d59b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.325883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778bb98-8651-4bac-8ff9-3278ff0cda8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.326408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b819a7-300e-4cb5-b542-b170a67d59b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.327340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778bb98-8651-4bac-8ff9-3278ff0cda8f admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.327441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b819a7-300e-4cb5-b542-b170a67d59b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.327572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778bb98-8651-4bac-8ff9-3278ff0cda8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.327739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b819a7-300e-4cb5-b542-b170a67d59b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.327862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778bb98-8651-4bac-8ff9-3278ff0cda8f admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.327967 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b819a7-300e-4cb5-b542-b170a67d59b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.328052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778bb98-8651-4bac-8ff9-3278ff0cda8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.329831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b819a7-300e-4cb5-b542-b170a67d59b1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.330027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778bb98-8651-4bac-8ff9-3278ff0cda8f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.352903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 794/1583] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:07.354225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53f940-9230-4820-95d2-9f242536c98b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.354509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53f940-9230-4820-95d2-9f242536c98b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.354779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53f940-9230-4820-95d2-9f242536c98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.375531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-cf53f940-9230-4820-95d2-9f242536c98b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:07.376798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cf53f940-9230-4820-95d2-9f242536c98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:07.382857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 790/1584] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:07.382857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382919f7-c1f4-4982-bb10-c3d144e248af None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.382857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382919f7-c1f4-4982-bb10-c3d144e248af None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.382857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382919f7-c1f4-4982-bb10-c3d144e248af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.408488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-382919f7-c1f4-4982-bb10-c3d144e248af None None] MFA Rules not processed for user `5670565ff02147ec80c0d2cb7fad174b`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:07.409810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-382919f7-c1f4-4982-bb10-c3d144e248af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:07.436776 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 795/1585] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:07.441033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53f940-9230-4820-95d2-9f242536c98b None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.451214 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53f940-9230-4820-95d2-9f242536c98b None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.457667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff214d-78e5-49b5-b1a0-58f8b9e0b748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.458368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff214d-78e5-49b5-b1a0-58f8b9e0b748 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.458650 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff214d-78e5-49b5-b1a0-58f8b9e0b748 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.458930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff214d-78e5-49b5-b1a0-58f8b9e0b748 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.459645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff214d-78e5-49b5-b1a0-58f8b9e0b748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.461890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff214d-78e5-49b5-b1a0-58f8b9e0b748 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.482877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 791/1586] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:07.484063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382919f7-c1f4-4982-bb10-c3d144e248af None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.489353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 796/1587] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/users => generated 288 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:07.490698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff214d-78e5-49b5-b1a0-58f8b9e0b748 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.496815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382919f7-c1f4-4982-bb10-c3d144e248af None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.501767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8096-c5fc-44b6-a955-93130c27fe47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.502123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff214d-78e5-49b5-b1a0-58f8b9e0b748 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.502485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8096-c5fc-44b6-a955-93130c27fe47 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.502764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8096-c5fc-44b6-a955-93130c27fe47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.503034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8096-c5fc-44b6-a955-93130c27fe47 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.503894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8096-c5fc-44b6-a955-93130c27fe47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.506067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8096-c5fc-44b6-a955-93130c27fe47 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.508383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf006-0e5c-472f-b4d7-71aea7619a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.509120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf006-0e5c-472f-b4d7-71aea7619a7b admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.509431 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf006-0e5c-472f-b4d7-71aea7619a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.509678 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcdf006-0e5c-472f-b4d7-71aea7619a7b admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.510394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdf006-0e5c-472f-b4d7-71aea7619a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.512334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcdf006-0e5c-472f-b4d7-71aea7619a7b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.527717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 792/1588] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/users => generated 286 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:07.528500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8096-c5fc-44b6-a955-93130c27fe47 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.534493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 797/1589] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:07.535507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf006-0e5c-472f-b4d7-71aea7619a7b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.545899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8096-c5fc-44b6-a955-93130c27fe47 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.547699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcdf006-0e5c-472f-b4d7-71aea7619a7b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.551428 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c273c-d9c2-4f9d-a5d6-f96f21b7c476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.552141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c273c-d9c2-4f9d-a5d6-f96f21b7c476 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.552420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c273c-d9c2-4f9d-a5d6-f96f21b7c476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.552933 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c273c-d9c2-4f9d-a5d6-f96f21b7c476 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.553171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4563e-0997-414f-9614-792f151440ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.553600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c273c-d9c2-4f9d-a5d6-f96f21b7c476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.553823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4563e-0997-414f-9614-792f151440ea admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.554116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4563e-0997-414f-9614-792f151440ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.554388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4563e-0997-414f-9614-792f151440ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.555129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4563e-0997-414f-9614-792f151440ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.556773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4563e-0997-414f-9614-792f151440ea admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.557628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c273c-d9c2-4f9d-a5d6-f96f21b7c476 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.568532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 798/1590] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:07.569465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4563e-0997-414f-9614-792f151440ea admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.579772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4563e-0997-414f-9614-792f151440ea admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.581504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 793/1591] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:07.582737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c273c-d9c2-4f9d-a5d6-f96f21b7c476 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.586827 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af2dbf-822a-4683-a7e5-22e556c5931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.587572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af2dbf-822a-4683-a7e5-22e556c5931b admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.587855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af2dbf-822a-4683-a7e5-22e556c5931b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.588172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af2dbf-822a-4683-a7e5-22e556c5931b admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.588888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af2dbf-822a-4683-a7e5-22e556c5931b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.590769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af2dbf-822a-4683-a7e5-22e556c5931b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.616030 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 799/1592] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:07 2021] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:07.617069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af2dbf-822a-4683-a7e5-22e556c5931b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.632793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af2dbf-822a-4683-a7e5-22e556c5931b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.639165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c0582-3d43-44ba-897f-3af3bee9e8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.639859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c0582-3d43-44ba-897f-3af3bee9e8fa admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.640136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c0582-3d43-44ba-897f-3af3bee9e8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.640406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c0582-3d43-44ba-897f-3af3bee9e8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.641188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c0582-3d43-44ba-897f-3af3bee9e8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.642824 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c0582-3d43-44ba-897f-3af3bee9e8fa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.650305 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c273c-d9c2-4f9d-a5d6-f96f21b7c476 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.658288 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef245493-0bff-4206-b180-8f042b8db690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.658491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 800/1593] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:07.658608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef245493-0bff-4206-b180-8f042b8db690 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.658608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef245493-0bff-4206-b180-8f042b8db690 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.658793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c0582-3d43-44ba-897f-3af3bee9e8fa admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.658890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef245493-0bff-4206-b180-8f042b8db690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.667223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef245493-0bff-4206-b180-8f042b8db690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.668727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef245493-0bff-4206-b180-8f042b8db690 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.679294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 794/1594] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:07.679545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef245493-0bff-4206-b180-8f042b8db690 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.690526 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef245493-0bff-4206-b180-8f042b8db690 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.696364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8642fd4-f125-4a08-ba2b-1f3c5cbbcfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.697080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642fd4-f125-4a08-ba2b-1f3c5cbbcfec admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.697359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642fd4-f125-4a08-ba2b-1f3c5cbbcfec admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.697650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642fd4-f125-4a08-ba2b-1f3c5cbbcfec admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.698443 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8642fd4-f125-4a08-ba2b-1f3c5cbbcfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.700096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8642fd4-f125-4a08-ba2b-1f3c5cbbcfec admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.711561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 795/1595] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:07.712861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8642fd4-f125-4a08-ba2b-1f3c5cbbcfec admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.723452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8642fd4-f125-4a08-ba2b-1f3c5cbbcfec admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.725082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c0582-3d43-44ba-897f-3af3bee9e8fa admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.728807 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db5ab0-546e-4aa2-8bc2-125266978fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.729053 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e1442-03b1-49b8-af31-c12eb0eeb913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.729784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e1442-03b1-49b8-af31-c12eb0eeb913 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.730068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e1442-03b1-49b8-af31-c12eb0eeb913 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.730195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db5ab0-546e-4aa2-8bc2-125266978fca admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.730392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e1442-03b1-49b8-af31-c12eb0eeb913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.730502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db5ab0-546e-4aa2-8bc2-125266978fca admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.730721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db5ab0-546e-4aa2-8bc2-125266978fca admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.731416 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db5ab0-546e-4aa2-8bc2-125266978fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.733100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db5ab0-546e-4aa2-8bc2-125266978fca admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.741858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e1442-03b1-49b8-af31-c12eb0eeb913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.744040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e1442-03b1-49b8-af31-c12eb0eeb913 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.749114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 796/1596] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:07.749114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db5ab0-546e-4aa2-8bc2-125266978fca admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.756265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 801/1597] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:07.757101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e1442-03b1-49b8-af31-c12eb0eeb913 service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.757732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db5ab0-546e-4aa2-8bc2-125266978fca admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.763056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d64d7e-2280-4ec3-9cdb-67b1d16dd4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.763836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d64d7e-2280-4ec3-9cdb-67b1d16dd4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.764311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d64d7e-2280-4ec3-9cdb-67b1d16dd4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.764462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d64d7e-2280-4ec3-9cdb-67b1d16dd4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.765379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d64d7e-2280-4ec3-9cdb-67b1d16dd4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.767749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d64d7e-2280-4ec3-9cdb-67b1d16dd4e7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.768538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e1442-03b1-49b8-af31-c12eb0eeb913 service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.775863 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2253-b4b2-4601-8e81-463a0084532a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.777521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2253-b4b2-4601-8e81-463a0084532a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.778133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2253-b4b2-4601-8e81-463a0084532a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.778560 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa2253-b4b2-4601-8e81-463a0084532a admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.779857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2253-b4b2-4601-8e81-463a0084532a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.782172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa2253-b4b2-4601-8e81-463a0084532a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.783798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 797/1598] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:07.784947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d64d7e-2280-4ec3-9cdb-67b1d16dd4e7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.794988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 802/1599] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:07.795778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d64d7e-2280-4ec3-9cdb-67b1d16dd4e7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.796195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2253-b4b2-4601-8e81-463a0084532a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.807016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac562c7-47a6-4d12-9d3b-647727694b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.807900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac562c7-47a6-4d12-9d3b-647727694b65 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.808265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac562c7-47a6-4d12-9d3b-647727694b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.808764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac562c7-47a6-4d12-9d3b-647727694b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.809523 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac562c7-47a6-4d12-9d3b-647727694b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.811033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa2253-b4b2-4601-8e81-463a0084532a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.811489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac562c7-47a6-4d12-9d3b-647727694b65 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.817704 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496cb25-ce5c-4ed3-a37a-fd1b5299a4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.819177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496cb25-ce5c-4ed3-a37a-fd1b5299a4ca admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.819529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496cb25-ce5c-4ed3-a37a-fd1b5299a4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.819898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496cb25-ce5c-4ed3-a37a-fd1b5299a4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.821137 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496cb25-ce5c-4ed3-a37a-fd1b5299a4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.822941 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496cb25-ce5c-4ed3-a37a-fd1b5299a4ca admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.824424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 798/1600] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:07.825158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac562c7-47a6-4d12-9d3b-647727694b65 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.837604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac562c7-47a6-4d12-9d3b-647727694b65 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.839385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 803/1601] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:07.840368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496cb25-ce5c-4ed3-a37a-fd1b5299a4ca admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.843544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995d01b-3375-4915-b90e-14265a44a61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.844227 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995d01b-3375-4915-b90e-14265a44a61c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.844549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995d01b-3375-4915-b90e-14265a44a61c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.844927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995d01b-3375-4915-b90e-14265a44a61c admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.845595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995d01b-3375-4915-b90e-14265a44a61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.847379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995d01b-3375-4915-b90e-14265a44a61c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.853814 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496cb25-ce5c-4ed3-a37a-fd1b5299a4ca admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.860960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33972e-d30a-409f-850f-9419a2deebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.862745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33972e-d30a-409f-850f-9419a2deebde admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.863356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 799/1602] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:07.863860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33972e-d30a-409f-850f-9419a2deebde admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.864299 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33972e-d30a-409f-850f-9419a2deebde admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.864524 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995d01b-3375-4915-b90e-14265a44a61c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.865428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33972e-d30a-409f-850f-9419a2deebde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.867794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33972e-d30a-409f-850f-9419a2deebde admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.877181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995d01b-3375-4915-b90e-14265a44a61c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.884690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 804/1603] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:07.884690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33972e-d30a-409f-850f-9419a2deebde admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.886194 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ec91e-34b7-4543-95db-5aa066b02882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.887032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ec91e-34b7-4543-95db-5aa066b02882 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.887310 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ec91e-34b7-4543-95db-5aa066b02882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.887577 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191ec91e-34b7-4543-95db-5aa066b02882 admin admin] PATH_INFO: `/v3/projects/05a93b2ff290400287bf3d9b544a810d/users/1a90c8e90b1545309a17a5ec314739e7/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.895842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33972e-d30a-409f-850f-9419a2deebde admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:07.901605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91806a-d6de-4419-b46c-50b166c7a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:07.902461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91806a-d6de-4419-b46c-50b166c7a0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:07.903204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91806a-d6de-4419-b46c-50b166c7a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:07.903524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91806a-d6de-4419-b46c-50b166c7a0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:07.904338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91806a-d6de-4419-b46c-50b166c7a0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.906723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91806a-d6de-4419-b46c-50b166c7a0b9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.911093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ec91e-34b7-4543-95db-5aa066b02882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a93b2ff290400287bf3d9b544a810d, user_id=1a90c8e90b1545309a17a5ec314739e7, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:07.914701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191ec91e-34b7-4543-95db-5aa066b02882 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:07.922602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 805/1604] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:07.925108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91806a-d6de-4419-b46c-50b166c7a0b9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.953302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 800/1605] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:07 2021] PUT /identity/v3/projects/05a93b2ff290400287bf3d9b544a810d/users/1a90c8e90b1545309a17a5ec314739e7/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:07.956712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ec91e-34b7-4543-95db-5aa066b02882 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:07.960640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91806a-d6de-4419-b46c-50b166c7a0b9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:08.048747 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191ec91e-34b7-4543-95db-5aa066b02882 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:08.053982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d116f-c4b3-4999-ae10-dc644bf043da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:08.054681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d116f-c4b3-4999-ae10-dc644bf043da admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.054961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d116f-c4b3-4999-ae10-dc644bf043da admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.055234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d116f-c4b3-4999-ae10-dc644bf043da admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.055993 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d116f-c4b3-4999-ae10-dc644bf043da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:08.056997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43392d1d-3865-4a73-b4e2-20fb1503a649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:08.057683 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d116f-c4b3-4999-ae10-dc644bf043da admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:08.059418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43392d1d-3865-4a73-b4e2-20fb1503a649 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.060007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43392d1d-3865-4a73-b4e2-20fb1503a649 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.060431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43392d1d-3865-4a73-b4e2-20fb1503a649 admin admin] PATH_INFO: `/v3/projects/6612774b121e4b92a1e6994061c2f83b/users/d76292ab10394b30bd758ee171574c82/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.069499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 806/1606] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:07 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:08.070430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d116f-c4b3-4999-ae10-dc644bf043da admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:08.081927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43392d1d-3865-4a73-b4e2-20fb1503a649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6612774b121e4b92a1e6994061c2f83b, user_id=d76292ab10394b30bd758ee171574c82, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:08.087786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d116f-c4b3-4999-ae10-dc644bf043da admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:08.094276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43392d1d-3865-4a73-b4e2-20fb1503a649 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:08.107512 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3b278-1bb6-4e47-8975-e223dca16737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:08.109396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3b278-1bb6-4e47-8975-e223dca16737 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.110486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3b278-1bb6-4e47-8975-e223dca16737 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.110830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3b278-1bb6-4e47-8975-e223dca16737 admin admin] PATH_INFO: `/v3/projects/162eec3f3527494a8bd4de1d5583a384/users/0d8226a06d384a1cae8a5655572f6164/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.134730 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 801/1607] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:07 2021] PUT /identity/v3/projects/6612774b121e4b92a1e6994061c2f83b/users/d76292ab10394b30bd758ee171574c82/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:08.135585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43392d1d-3865-4a73-b4e2-20fb1503a649 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:08.160405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3b278-1bb6-4e47-8975-e223dca16737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162eec3f3527494a8bd4de1d5583a384, user_id=0d8226a06d384a1cae8a5655572f6164, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:08.163206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c3b278-1bb6-4e47-8975-e223dca16737 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:08.191704 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 807/1608] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:08 2021] PUT /identity/v3/projects/162eec3f3527494a8bd4de1d5583a384/users/0d8226a06d384a1cae8a5655572f6164/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:08.192366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3b278-1bb6-4e47-8975-e223dca16737 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:08.234860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43392d1d-3865-4a73-b4e2-20fb1503a649 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:08.279882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3b278-1bb6-4e47-8975-e223dca16737 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:08.290892 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f787b-5394-431f-bb84-a557c06786ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:08.295007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f787b-5394-431f-bb84-a557c06786ac admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.295468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f787b-5394-431f-bb84-a557c06786ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.296007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f787b-5394-431f-bb84-a557c06786ac admin admin] PATH_INFO: `/v3/projects/c94e8e265a6f4fb585504a1e95ceda28/users/e9c2500682e64b3a91e811a3ba09bd20/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.324997 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f787b-5394-431f-bb84-a557c06786ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c94e8e265a6f4fb585504a1e95ceda28, user_id=e9c2500682e64b3a91e811a3ba09bd20, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:08.329535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f787b-5394-431f-bb84-a557c06786ac admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:08.343814 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc897cc-abf9-438d-ac86-d648fb1c0ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:08.345480 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc897cc-abf9-438d-ac86-d648fb1c0ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.346028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc897cc-abf9-438d-ac86-d648fb1c0ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.346649 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc897cc-abf9-438d-ac86-d648fb1c0ce9 admin admin] PATH_INFO: `/v3/projects/febd1024088a4a22984d59922da28de1/users/c282fd140f5645ca89c2e64888ea1345/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.350114 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 808/1609] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:08 2021] PUT /identity/v3/projects/c94e8e265a6f4fb585504a1e95ceda28/users/e9c2500682e64b3a91e811a3ba09bd20/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:08.355620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3a88c-2d2b-4f34-80b0-a38e39bc5611 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.355915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3a88c-2d2b-4f34-80b0-a38e39bc5611 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.356177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3a88c-2d2b-4f34-80b0-a38e39bc5611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.386484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc897cc-abf9-438d-ac86-d648fb1c0ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=febd1024088a4a22984d59922da28de1, user_id=c282fd140f5645ca89c2e64888ea1345, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:08.389415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc897cc-abf9-438d-ac86-d648fb1c0ce9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:08.412849 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 802/1610] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:08 2021] PUT /identity/v3/projects/febd1024088a4a22984d59922da28de1/users/c282fd140f5645ca89c2e64888ea1345/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:08.413229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-cbe3a88c-2d2b-4f34-80b0-a38e39bc5611 None None] MFA Rules not processed for user `1a90c8e90b1545309a17a5ec314739e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:08.414185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cbe3a88c-2d2b-4f34-80b0-a38e39bc5611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:08.414908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc897cc-abf9-438d-ac86-d648fb1c0ce9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:08.554994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc897cc-abf9-438d-ac86-d648fb1c0ce9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:08.559999 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 809/1611] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:08.562248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850266d-9082-40c6-8b96-e980a39be53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:08.562449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbee1f2-066e-49b6-97a2-ae6a5e9fbedd None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.562561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbee1f2-066e-49b6-97a2-ae6a5e9fbedd None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.563169 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbee1f2-066e-49b6-97a2-ae6a5e9fbedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.564322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850266d-9082-40c6-8b96-e980a39be53b admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.564825 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850266d-9082-40c6-8b96-e980a39be53b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.565201 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850266d-9082-40c6-8b96-e980a39be53b admin admin] PATH_INFO: `/v3/projects/8a4c36f75de14e7a830701e0966f4c73/users/ae13457dcc62443ca11b020300b38cca/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.597527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850266d-9082-40c6-8b96-e980a39be53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a4c36f75de14e7a830701e0966f4c73, user_id=ae13457dcc62443ca11b020300b38cca, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:08.601180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850266d-9082-40c6-8b96-e980a39be53b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:08.614382 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-6bbee1f2-066e-49b6-97a2-ae6a5e9fbedd None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:08.615897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6bbee1f2-066e-49b6-97a2-ae6a5e9fbedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:08.625040 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 803/1612] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:08 2021] PUT /identity/v3/projects/8a4c36f75de14e7a830701e0966f4c73/users/ae13457dcc62443ca11b020300b38cca/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:08.633364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8304394-7946-4e52-a266-f480c856f8dc None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.633722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8304394-7946-4e52-a266-f480c856f8dc None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.633929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8304394-7946-4e52-a266-f480c856f8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.674065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f8304394-7946-4e52-a266-f480c856f8dc None None] MFA Rules not processed for user `0d8226a06d384a1cae8a5655572f6164`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:08.676023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f8304394-7946-4e52-a266-f480c856f8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:08.722296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 810/1613] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:08.722296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5759a9-a950-40e2-839f-493f74673000 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.722296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5759a9-a950-40e2-839f-493f74673000 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.722296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5759a9-a950-40e2-839f-493f74673000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.743140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9c5759a9-a950-40e2-839f-493f74673000 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:08.744706 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9c5759a9-a950-40e2-839f-493f74673000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:08.763566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 811/1614] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:08.765220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b24b7-a84a-4ab1-bee7-6eb761950144 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.765510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b24b7-a84a-4ab1-bee7-6eb761950144 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.765785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b24b7-a84a-4ab1-bee7-6eb761950144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.786980 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-580b24b7-a84a-4ab1-bee7-6eb761950144 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:08.788089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-580b24b7-a84a-4ab1-bee7-6eb761950144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:08.796688 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 804/1615] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:08.796688 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8304394-7946-4e52-a266-f480c856f8dc None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:08.799195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 812/1616] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:08.801275 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eefa7a-a31b-46f8-ba22-b838da355d19 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.813040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eefa7a-a31b-46f8-ba22-b838da355d19 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.813443 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8304394-7946-4e52-a266-f480c856f8dc None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:08.814084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eefa7a-a31b-46f8-ba22-b838da355d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.821610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a1d0a-76f8-44eb-852f-a944abfd2cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:08.822295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a1d0a-76f8-44eb-852f-a944abfd2cec admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.823480 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a1d0a-76f8-44eb-852f-a944abfd2cec admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.823480 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a1d0a-76f8-44eb-852f-a944abfd2cec admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.823777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a1d0a-76f8-44eb-852f-a944abfd2cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:08.827432 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a1d0a-76f8-44eb-852f-a944abfd2cec admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:08.848246 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a6eefa7a-a31b-46f8-ba22-b838da355d19 None None] MFA Rules not processed for user `956e41eae5f24c328f1cb8a8efffa5c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:08.849636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a6eefa7a-a31b-46f8-ba22-b838da355d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:08.868827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 805/1617] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:08 2021] POST /identity/v3/projects => generated 403 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:08.868827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a461f4-b6ba-475b-aa47-0b9b7a3397f0 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:08.868827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a461f4-b6ba-475b-aa47-0b9b7a3397f0 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:08.868827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a461f4-b6ba-475b-aa47-0b9b7a3397f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:08.903878 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-73a461f4-b6ba-475b-aa47-0b9b7a3397f0 None None] MFA Rules not processed for user `ae13457dcc62443ca11b020300b38cca`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:08.905183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-73a461f4-b6ba-475b-aa47-0b9b7a3397f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:08.934034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 813/1618] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:08.938519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eefa7a-a31b-46f8-ba22-b838da355d19 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:08.997059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 806/1619] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:08 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:08.998326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a461f4-b6ba-475b-aa47-0b9b7a3397f0 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.000851 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-73a461f4-b6ba-475b-aa47-0b9b7a3397f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:09.018841 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eefa7a-a31b-46f8-ba22-b838da355d19 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.077353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc07e2-790b-4928-baa1-c24ad038e35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.078151 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc07e2-790b-4928-baa1-c24ad038e35d service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.078557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc07e2-790b-4928-baa1-c24ad038e35d service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.078918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc07e2-790b-4928-baa1-c24ad038e35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.088021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a461f4-b6ba-475b-aa47-0b9b7a3397f0 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.093189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f25e55-9db2-4e48-854f-7e8709d9871e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.093853 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25e55-9db2-4e48-854f-7e8709d9871e service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.094133 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25e55-9db2-4e48-854f-7e8709d9871e service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.094412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f25e55-9db2-4e48-854f-7e8709d9871e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.156723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc07e2-790b-4928-baa1-c24ad038e35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.158427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc07e2-790b-4928-baa1-c24ad038e35d service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.170628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 814/1620] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:09.171785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc07e2-790b-4928-baa1-c24ad038e35d service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.175574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f25e55-9db2-4e48-854f-7e8709d9871e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.177080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f25e55-9db2-4e48-854f-7e8709d9871e service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.181288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc07e2-790b-4928-baa1-c24ad038e35d service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.187033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedc081-9d33-4b36-aa95-4f83b8ff2941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.187636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedc081-9d33-4b36-aa95-4f83b8ff2941 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.187912 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedc081-9d33-4b36-aa95-4f83b8ff2941 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.188178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbedc081-9d33-4b36-aa95-4f83b8ff2941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.189761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 807/1621] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:09.192561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e40c55-41b7-43ff-85ab-474324754195 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.192561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e40c55-41b7-43ff-85ab-474324754195 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.192561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e40c55-41b7-43ff-85ab-474324754195 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.194212 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 808/1622] 10.222.0.62 () {54 vars in 961 bytes} [Mon Dec 13 16:48:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:48:09.201737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedc081-9d33-4b36-aa95-4f83b8ff2941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.202482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e40c55-41b7-43ff-85ab-474324754195 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.203285 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbedc081-9d33-4b36-aa95-4f83b8ff2941 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.222398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 815/1623] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:09.222835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e40c55-41b7-43ff-85ab-474324754195 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.223385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedc081-9d33-4b36-aa95-4f83b8ff2941 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.230143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687cc2e-eea2-4e13-904e-494a7b451672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.231608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687cc2e-eea2-4e13-904e-494a7b451672 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.231898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687cc2e-eea2-4e13-904e-494a7b451672 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.232202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687cc2e-eea2-4e13-904e-494a7b451672 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.233062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687cc2e-eea2-4e13-904e-494a7b451672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.235260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687cc2e-eea2-4e13-904e-494a7b451672 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.242264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbedc081-9d33-4b36-aa95-4f83b8ff2941 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.253577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391caa68-48b6-4642-af65-dcc61fabd80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.254627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391caa68-48b6-4642-af65-dcc61fabd80e admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.254990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391caa68-48b6-4642-af65-dcc61fabd80e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.255277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391caa68-48b6-4642-af65-dcc61fabd80e admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.256177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391caa68-48b6-4642-af65-dcc61fabd80e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.258361 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391caa68-48b6-4642-af65-dcc61fabd80e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.272694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 809/1624] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:09 2021] POST /identity/v3/users => generated 308 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:09.275262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f935-13ba-42e9-8064-9566132aa29c None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.276061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f935-13ba-42e9-8064-9566132aa29c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.276765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f935-13ba-42e9-8064-9566132aa29c None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.280963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 810/1625] 10.222.0.62 () {54 vars in 961 bytes} [Mon Dec 13 16:48:09 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:48:09.283617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b450f-4d74-4bdf-944a-6f656c1dbb4e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.284032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b450f-4d74-4bdf-944a-6f656c1dbb4e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.284441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b450f-4d74-4bdf-944a-6f656c1dbb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.304545 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 816/1626] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:09 2021] POST /identity/v3/projects => generated 403 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:09.305757 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391caa68-48b6-4642-af65-dcc61fabd80e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.323211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-1b6b450f-4d74-4bdf-944a-6f656c1dbb4e None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:09.325729 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1b6b450f-4d74-4bdf-944a-6f656c1dbb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:09.448971 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391caa68-48b6-4642-af65-dcc61fabd80e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.456185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d15e25-7573-442b-9e88-08750442311e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.457550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15e25-7573-442b-9e88-08750442311e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.457937 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15e25-7573-442b-9e88-08750442311e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.458194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d15e25-7573-442b-9e88-08750442311e admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.459610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d15e25-7573-442b-9e88-08750442311e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.461737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d15e25-7573-442b-9e88-08750442311e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.475398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 817/1627] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:09.479077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede1478-ce10-4a63-96b0-9793b2345d88 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.479077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede1478-ce10-4a63-96b0-9793b2345d88 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.479077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede1478-ce10-4a63-96b0-9793b2345d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.484471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 811/1628] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Dec 13 16:48:09 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:09.486353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b450f-4d74-4bdf-944a-6f656c1dbb4e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.507938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b450f-4d74-4bdf-944a-6f656c1dbb4e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.517042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9ede1478-ce10-4a63-96b0-9793b2345d88 None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:09.518846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9ede1478-ce10-4a63-96b0-9793b2345d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:09.521165 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58c373-61f8-4e68-9730-e74472d0c55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.523117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58c373-61f8-4e68-9730-e74472d0c55c admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.523522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58c373-61f8-4e68-9730-e74472d0c55c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.524280 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58c373-61f8-4e68-9730-e74472d0c55c admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.526014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58c373-61f8-4e68-9730-e74472d0c55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.529679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58c373-61f8-4e68-9730-e74472d0c55c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.555935 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 818/1629] 10.222.0.62 () {58 vars in 1058 bytes} [Mon Dec 13 16:48:09 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:09.557061 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede1478-ce10-4a63-96b0-9793b2345d88 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.566068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 812/1630] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:09 2021] POST /identity/v3/users => generated 308 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:09.567164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58c373-61f8-4e68-9730-e74472d0c55c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.579074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede1478-ce10-4a63-96b0-9793b2345d88 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.584482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc9339-82d6-4fdb-983b-e494f092ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.585489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58c373-61f8-4e68-9730-e74472d0c55c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.586583 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc9339-82d6-4fdb-983b-e494f092ea43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.586978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc9339-82d6-4fdb-983b-e494f092ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.587333 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc9339-82d6-4fdb-983b-e494f092ea43 admin admin] PATH_INFO: `/v3/projects/cc6a1d3036e54ffb8431b2b6832e0453/users/7dc1fa77c6074ae4b6c72ceef08d1243/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.594264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccad55-a8db-4b71-adac-e063445de1bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.594947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccad55-a8db-4b71-adac-e063445de1bd service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.595235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccad55-a8db-4b71-adac-e063445de1bd service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.595515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccad55-a8db-4b71-adac-e063445de1bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.617160 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc9339-82d6-4fdb-983b-e494f092ea43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc6a1d3036e54ffb8431b2b6832e0453, user_id=7dc1fa77c6074ae4b6c72ceef08d1243, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.621104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc9339-82d6-4fdb-983b-e494f092ea43 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.654708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 819/1631] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:09 2021] PUT /identity/v3/projects/cc6a1d3036e54ffb8431b2b6832e0453/users/7dc1fa77c6074ae4b6c72ceef08d1243/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:09.656222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc9339-82d6-4fdb-983b-e494f092ea43 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.682606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccad55-a8db-4b71-adac-e063445de1bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.684645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccad55-a8db-4b71-adac-e063445de1bd service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.708189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 813/1632] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:09 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:09.712358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccad55-a8db-4b71-adac-e063445de1bd service nova] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.740869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccad55-a8db-4b71-adac-e063445de1bd service nova] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.799418 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc9339-82d6-4fdb-983b-e494f092ea43 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.814551 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a35cc-8039-46c3-9ea3-b29d2dcc56b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.817969 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a35cc-8039-46c3-9ea3-b29d2dcc56b3 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.818286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a35cc-8039-46c3-9ea3-b29d2dcc56b3 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.819649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a35cc-8039-46c3-9ea3-b29d2dcc56b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.852801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe961ef-05ce-4845-b6f5-d8a4e88b7b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.853516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe961ef-05ce-4845-b6f5-d8a4e88b7b0e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.853804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe961ef-05ce-4845-b6f5-d8a4e88b7b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.854086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe961ef-05ce-4845-b6f5-d8a4e88b7b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.854855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe961ef-05ce-4845-b6f5-d8a4e88b7b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.862831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe961ef-05ce-4845-b6f5-d8a4e88b7b0e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.903447 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 814/1633] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:09.905598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe961ef-05ce-4845-b6f5-d8a4e88b7b0e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.930623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe961ef-05ce-4845-b6f5-d8a4e88b7b0e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.937352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b611402-dc06-4018-889b-96a3b78a6f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.938056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611402-dc06-4018-889b-96a3b78a6f02 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.938399 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611402-dc06-4018-889b-96a3b78a6f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.938680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611402-dc06-4018-889b-96a3b78a6f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.939589 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b611402-dc06-4018-889b-96a3b78a6f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.952592 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b611402-dc06-4018-889b-96a3b78a6f02 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.964027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 815/1634] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:09 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:09.965028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b611402-dc06-4018-889b-96a3b78a6f02 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:09.974513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a35cc-8039-46c3-9ea3-b29d2dcc56b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:09.976365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a35cc-8039-46c3-9ea3-b29d2dcc56b3 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:09.978145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b611402-dc06-4018-889b-96a3b78a6f02 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:09.983457 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4926b8-0af6-4850-9f01-8071d1fea257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:09.984804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4926b8-0af6-4850-9f01-8071d1fea257 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:09.984804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4926b8-0af6-4850-9f01-8071d1fea257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:09.985180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4926b8-0af6-4850-9f01-8071d1fea257 admin admin] PATH_INFO: `/v3/projects/29fdb72a76cb4a08ae761dae09338fdb/users/03741fc45fac4c7982a059ec22d12037/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:09.998892 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 820/1635] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:09 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:10.004067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4926b8-0af6-4850-9f01-8071d1fea257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29fdb72a76cb4a08ae761dae09338fdb, user_id=03741fc45fac4c7982a059ec22d12037, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:10.007255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4926b8-0af6-4850-9f01-8071d1fea257 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:10.011206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a35cc-8039-46c3-9ea3-b29d2dcc56b3 service nova] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:10.028383 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 816/1636] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:09 2021] PUT /identity/v3/projects/29fdb72a76cb4a08ae761dae09338fdb/users/03741fc45fac4c7982a059ec22d12037/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:10.033467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4926b8-0af6-4850-9f01-8071d1fea257 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:10.059772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a35cc-8039-46c3-9ea3-b29d2dcc56b3 service nova] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:10.133950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4926b8-0af6-4850-9f01-8071d1fea257 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:10.141031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc5c66-4b85-4760-a30e-ff659a5be0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:10.141904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5c66-4b85-4760-a30e-ff659a5be0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:10.142256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5c66-4b85-4760-a30e-ff659a5be0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:10.142597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc5c66-4b85-4760-a30e-ff659a5be0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:10.143707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc5c66-4b85-4760-a30e-ff659a5be0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:10.145843 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc5c66-4b85-4760-a30e-ff659a5be0b9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:10.170554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 817/1637] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:10 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:10.175941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc5c66-4b85-4760-a30e-ff659a5be0b9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:10.188777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc5c66-4b85-4760-a30e-ff659a5be0b9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:10.195346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5714ad-f313-4339-815d-13a1dfecb344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:10.196312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5714ad-f313-4339-815d-13a1dfecb344 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:10.196611 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5714ad-f313-4339-815d-13a1dfecb344 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:10.196889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5714ad-f313-4339-815d-13a1dfecb344 admin admin] PATH_INFO: `/v3/projects/29fdb72a76cb4a08ae761dae09338fdb/users/03741fc45fac4c7982a059ec22d12037/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:10.198978 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5714ad-f313-4339-815d-13a1dfecb344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29fdb72a76cb4a08ae761dae09338fdb, user_id=03741fc45fac4c7982a059ec22d12037, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:10.201813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5714ad-f313-4339-815d-13a1dfecb344 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:10.206254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef069381-b87e-411c-b850-33b4e18fad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:10.208278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef069381-b87e-411c-b850-33b4e18fad95 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:10.208564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef069381-b87e-411c-b850-33b4e18fad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:10.208925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef069381-b87e-411c-b850-33b4e18fad95 admin admin] PATH_INFO: `/v3/projects/cc6a1d3036e54ffb8431b2b6832e0453/users/7dc1fa77c6074ae4b6c72ceef08d1243/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:10.216615 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 818/1638] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:10 2021] PUT /identity/v3/projects/29fdb72a76cb4a08ae761dae09338fdb/users/03741fc45fac4c7982a059ec22d12037/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:10.216828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef069381-b87e-411c-b850-33b4e18fad95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc6a1d3036e54ffb8431b2b6832e0453, user_id=7dc1fa77c6074ae4b6c72ceef08d1243, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:10.218581 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef069381-b87e-411c-b850-33b4e18fad95 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:10.247548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 821/1639] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:10 2021] PUT /identity/v3/projects/cc6a1d3036e54ffb8431b2b6832e0453/users/7dc1fa77c6074ae4b6c72ceef08d1243/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:10.261223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265490-8a78-418f-a00d-4f5f728df806 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:10.261223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265490-8a78-418f-a00d-4f5f728df806 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:10.261551 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6265490-8a78-418f-a00d-4f5f728df806 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:10.262943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b97db3-78b7-4f1f-aeaf-2c161325e8b9 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:10.263258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b97db3-78b7-4f1f-aeaf-2c161325e8b9 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:10.263571 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b97db3-78b7-4f1f-aeaf-2c161325e8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:10.263841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 819/1640] 10.222.0.62 () {54 vars in 912 bytes} [Mon Dec 13 16:48:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:48:10.269884 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569064c-e6c1-43b7-b5fb-080da9a7c2fe None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:10.270143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569064c-e6c1-43b7-b5fb-080da9a7c2fe None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:10.270472 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569064c-e6c1-43b7-b5fb-080da9a7c2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:10.293320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c569064c-e6c1-43b7-b5fb-080da9a7c2fe None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:10.296151 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c569064c-e6c1-43b7-b5fb-080da9a7c2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:10.307813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-78b97db3-78b7-4f1f-aeaf-2c161325e8b9 None None] MFA Rules not processed for user `7dc1fa77c6074ae4b6c72ceef08d1243`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:10.309534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-78b97db3-78b7-4f1f-aeaf-2c161325e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:10.388399 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 820/1641] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:48:10 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:48:10.396502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569064c-e6c1-43b7-b5fb-080da9a7c2fe None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:10.433044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 822/1642] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:10 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:10.446965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b97db3-78b7-4f1f-aeaf-2c161325e8b9 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:10.481323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569064c-e6c1-43b7-b5fb-080da9a7c2fe None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:10.495137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65912ef-6929-49ed-8435-0bc23fd39586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:10.495975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65912ef-6929-49ed-8435-0bc23fd39586 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:10.496354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65912ef-6929-49ed-8435-0bc23fd39586 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:10.496808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65912ef-6929-49ed-8435-0bc23fd39586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:10.514022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65912ef-6929-49ed-8435-0bc23fd39586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:10.516326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65912ef-6929-49ed-8435-0bc23fd39586 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:10.530556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 821/1643] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:48:10.536929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b97db3-78b7-4f1f-aeaf-2c161325e8b9 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:10.548639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d893-a26c-49d3-814d-e76572a83622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:10.549881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d893-a26c-49d3-814d-e76572a83622 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:10.550658 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d893-a26c-49d3-814d-e76572a83622 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:10.551133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95d893-a26c-49d3-814d-e76572a83622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:10.557668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81e49c-1b85-4508-bc28-7ee20d506897 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:10.558035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81e49c-1b85-4508-bc28-7ee20d506897 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:10.558263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81e49c-1b85-4508-bc28-7ee20d506897 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:10.560468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 822/1644] 10.222.0.62 () {54 vars in 912 bytes} [Mon Dec 13 16:48:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:48:10.569456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201989e-d3cd-4d50-80ae-4553fa536eb2 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:10.569839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201989e-d3cd-4d50-80ae-4553fa536eb2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:10.570215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201989e-d3cd-4d50-80ae-4553fa536eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:10.584048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95d893-a26c-49d3-814d-e76572a83622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:10.587523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95d893-a26c-49d3-814d-e76572a83622 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:10.626106 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 823/1645] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:10 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:48:10.627344 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7201989e-d3cd-4d50-80ae-4553fa536eb2 None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:10.628776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7201989e-d3cd-4d50-80ae-4553fa536eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:10.657314 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 823/1646] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:48:10 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:10.710504 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d893-a26c-49d3-814d-e76572a83622 service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:10.743195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95d893-a26c-49d3-814d-e76572a83622 service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:10.755379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b7f27-85e2-4c7e-a880-738d9491b1fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:10.756308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7f27-85e2-4c7e-a880-738d9491b1fb service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:10.756636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7f27-85e2-4c7e-a880-738d9491b1fb service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:10.756919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b7f27-85e2-4c7e-a880-738d9491b1fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:10.778108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b7f27-85e2-4c7e-a880-738d9491b1fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:10.779590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b7f27-85e2-4c7e-a880-738d9491b1fb service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:10.824282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 824/1647] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:11.487574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5e63f-926f-409b-9961-f2621dd9ae7d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:11.488878 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5e63f-926f-409b-9961-f2621dd9ae7d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:11.489757 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5e63f-926f-409b-9961-f2621dd9ae7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:11.614529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-08a5e63f-926f-409b-9961-f2621dd9ae7d None None] MFA Rules not processed for user `d76292ab10394b30bd758ee171574c82`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:11.616079 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-08a5e63f-926f-409b-9961-f2621dd9ae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:11.907509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 824/1648] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:11 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:11.919358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f8659-7318-4f03-a5b5-1a525185ee04 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:11.920601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f8659-7318-4f03-a5b5-1a525185ee04 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:11.921413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f8659-7318-4f03-a5b5-1a525185ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:11.933960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5e63f-926f-409b-9961-f2621dd9ae7d None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:11.960248 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-1e9f8659-7318-4f03-a5b5-1a525185ee04 None None] MFA Rules not processed for user `d76292ab10394b30bd758ee171574c82`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:11.961267 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1e9f8659-7318-4f03-a5b5-1a525185ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:11.975095 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 825/1649] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:11 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:12.014364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f8659-7318-4f03-a5b5-1a525185ee04 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:12.065655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f8659-7318-4f03-a5b5-1a525185ee04 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:12.086156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa1384-2f17-42a5-8c3e-b825a3890184 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:12.087356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa1384-2f17-42a5-8c3e-b825a3890184 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:12.089194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa1384-2f17-42a5-8c3e-b825a3890184 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:12.089601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa1384-2f17-42a5-8c3e-b825a3890184 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:12.112766 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5e63f-926f-409b-9961-f2621dd9ae7d None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:12.127645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa1384-2f17-42a5-8c3e-b825a3890184 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:12.128856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d5777-9486-4d31-bbea-6005eee0ee8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:12.151507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa1384-2f17-42a5-8c3e-b825a3890184 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:12.151714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5777-9486-4d31-bbea-6005eee0ee8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:12.151714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5777-9486-4d31-bbea-6005eee0ee8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:12.151714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d5777-9486-4d31-bbea-6005eee0ee8a admin admin] PATH_INFO: `/v3/users/1a90c8e90b1545309a17a5ec314739e7` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:12.151714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d5777-9486-4d31-bbea-6005eee0ee8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a90c8e90b1545309a17a5ec314739e7)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:12.161476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d5777-9486-4d31-bbea-6005eee0ee8a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:12.180306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 826/1650] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:12 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:12.181876 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa1384-2f17-42a5-8c3e-b825a3890184 service nova] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:12.196421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa1384-2f17-42a5-8c3e-b825a3890184 service nova] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:12.203291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:12.205417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:12.206196 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:12.208410 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] PATH_INFO: `/v3/users/ae13457dcc62443ca11b020300b38cca` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:12.211984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae13457dcc62443ca11b020300b38cca)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:12.213696 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: WARNING py.warnings [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:48:12.213696 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: warnings.warn(msg) Dec 13 16:48:12.213696 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: Dec 13 16:48:12.216790 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:12.249383 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-1c6d5777-9486-4d31-bbea-6005eee0ee8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a90c8e90b1545309a17a5ec314739e7'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:12.292150 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-1c6d5777-9486-4d31-bbea-6005eee0ee8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a90c8e90b1545309a17a5ec314739e7'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:12.307550 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-1c6d5777-9486-4d31-bbea-6005eee0ee8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a90c8e90b1545309a17a5ec314739e7'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:12.342613 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-1c6d5777-9486-4d31-bbea-6005eee0ee8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a90c8e90b1545309a17a5ec314739e7'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:12.345481 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-1c6d5777-9486-4d31-bbea-6005eee0ee8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a90c8e90b1545309a17a5ec314739e7'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:12.370954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 825/1651] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:11 2021] DELETE /identity/v3/users/1a90c8e90b1545309a17a5ec314739e7 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:48:12.375031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ff1d-1bd0-4417-ae70-97beeaf5abe2 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:12.375657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ff1d-1bd0-4417-ae70-97beeaf5abe2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:12.375833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5508ff1d-1bd0-4417-ae70-97beeaf5abe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:12.399509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae13457dcc62443ca11b020300b38cca'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:12.440734 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-5508ff1d-1bd0-4417-ae70-97beeaf5abe2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:12.442327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-5508ff1d-1bd0-4417-ae70-97beeaf5abe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:12.482417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae13457dcc62443ca11b020300b38cca'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:12.483519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae13457dcc62443ca11b020300b38cca'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:12.511728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae13457dcc62443ca11b020300b38cca'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:12.547172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-87b9da17-6d91-4826-9156-c87ae4490f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae13457dcc62443ca11b020300b38cca'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:12.561010 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 827/1652] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:12 2021] DELETE /identity/v3/users/ae13457dcc62443ca11b020300b38cca => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:12.571128 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce68f8-1dd2-48ac-a184-2f23366e315d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:12.571513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce68f8-1dd2-48ac-a184-2f23366e315d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:12.571856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce68f8-1dd2-48ac-a184-2f23366e315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:12.588104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 826/1653] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:12.606027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c5ce68f8-1dd2-48ac-a184-2f23366e315d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:12.608456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c5ce68f8-1dd2-48ac-a184-2f23366e315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:12.615500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508ff1d-1bd0-4417-ae70-97beeaf5abe2 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:12.617181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-5508ff1d-1bd0-4417-ae70-97beeaf5abe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:12.835755 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5508ff1d-1bd0-4417-ae70-97beeaf5abe2 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:12.872099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 828/1654] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:12.872099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16166e-83c9-4131-87a3-3c7116cb3159 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:12.872099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16166e-83c9-4131-87a3-3c7116cb3159 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:12.872099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16166e-83c9-4131-87a3-3c7116cb3159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:12.915364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86b4cf-12de-4ff2-a0d9-6ad1c41da55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:12.916358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b4cf-12de-4ff2-a0d9-6ad1c41da55a service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:12.916758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b4cf-12de-4ff2-a0d9-6ad1c41da55a service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:12.917099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b4cf-12de-4ff2-a0d9-6ad1c41da55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:12.931743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86b4cf-12de-4ff2-a0d9-6ad1c41da55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:12.933734 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86b4cf-12de-4ff2-a0d9-6ad1c41da55a service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:12.954789 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 827/1655] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:48:12.956930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86b4cf-12de-4ff2-a0d9-6ad1c41da55a service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:12.971237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86b4cf-12de-4ff2-a0d9-6ad1c41da55a service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:12.983415 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-1d16166e-83c9-4131-87a3-3c7116cb3159 None None] MFA Rules not processed for user `03741fc45fac4c7982a059ec22d12037`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:12.984681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1d16166e-83c9-4131-87a3-3c7116cb3159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:13.006325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa6abc-abc6-446e-afcf-b0f81c438412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:13.008758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6abc-abc6-446e-afcf-b0f81c438412 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:13.009260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6abc-abc6-446e-afcf-b0f81c438412 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:13.009776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6abc-abc6-446e-afcf-b0f81c438412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:13.078952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6abc-abc6-446e-afcf-b0f81c438412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:13.086931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6abc-abc6-446e-afcf-b0f81c438412 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:13.130318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 828/1656] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:13.130318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8fd1b-aa78-4295-891f-eb3f4fbe8362 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:13.130318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8fd1b-aa78-4295-891f-eb3f4fbe8362 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:13.130318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8fd1b-aa78-4295-891f-eb3f4fbe8362 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:13.130318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 829/1657] 10.222.0.62 () {54 vars in 912 bytes} [Mon Dec 13 16:48:13 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:48:13.137646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfed51-523a-45bb-a4ed-fc27b6a01e0d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:13.137986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfed51-523a-45bb-a4ed-fc27b6a01e0d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:13.138391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bfed51-523a-45bb-a4ed-fc27b6a01e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:13.230164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 829/1658] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:12 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:13.322408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-e1bfed51-523a-45bb-a4ed-fc27b6a01e0d None None] MFA Rules not processed for user `51f9a10e3d87475e92fb49686f1aa456`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:13.325465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e1bfed51-523a-45bb-a4ed-fc27b6a01e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:13.346504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 830/1659] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:48:13 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:13.364881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16166e-83c9-4131-87a3-3c7116cb3159 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:13.366355 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1d16166e-83c9-4131-87a3-3c7116cb3159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:13.391226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16166e-83c9-4131-87a3-3c7116cb3159 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:13.400069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091359a-eb8d-4a3b-a01b-f9a3aaf1affb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:13.401361 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091359a-eb8d-4a3b-a01b-f9a3aaf1affb service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:13.402480 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091359a-eb8d-4a3b-a01b-f9a3aaf1affb service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:13.403338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091359a-eb8d-4a3b-a01b-f9a3aaf1affb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:13.449283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091359a-eb8d-4a3b-a01b-f9a3aaf1affb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:13.453282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091359a-eb8d-4a3b-a01b-f9a3aaf1affb service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:13.484126 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 830/1660] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:13 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:14.476211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfed51-523a-45bb-a4ed-fc27b6a01e0d None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:14.477682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e1bfed51-523a-45bb-a4ed-fc27b6a01e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:14.541542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bfed51-523a-45bb-a4ed-fc27b6a01e0d None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:14.555542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:14.556764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:14.557241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:14.557677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] PATH_INFO: `/v3/projects/05a93b2ff290400287bf3d9b544a810d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:14.560059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a93b2ff290400287bf3d9b544a810d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:14.561582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: WARNING py.warnings [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1117: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Dec 13 16:48:14.561582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: warnings.warn(msg) Dec 13 16:48:14.561582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: Dec 13 16:48:14.563423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:14.679276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a93b2ff290400287bf3d9b544a810d', 'request_id': 'req-dd162daa-d542-4a4d-94c0-76c9949bdd3a'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:14.700715 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a93b2ff290400287bf3d9b544a810d', 'request_id': 'req-dd162daa-d542-4a4d-94c0-76c9949bdd3a'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:14.757561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a93b2ff290400287bf3d9b544a810d', 'request_id': 'req-dd162daa-d542-4a4d-94c0-76c9949bdd3a'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:14.791043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] The token cache is being invalidate because project 05a93b2ff290400287bf3d9b544a810d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:14.791568 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:14.792437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:14.794995 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 831/1661] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:14 2021] DELETE /identity/v3/projects/05a93b2ff290400287bf3d9b544a810d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:14.800789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091359a-eb8d-4a3b-a01b-f9a3aaf1affb service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:14.821068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091359a-eb8d-4a3b-a01b-f9a3aaf1affb service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:14.833380 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:14.834957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:14.966874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:14.967891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:14.968275 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:14.968654 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] PATH_INFO: `/v3/users/7dc1fa77c6074ae4b6c72ceef08d1243` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:14.970320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc1fa77c6074ae4b6c72ceef08d1243)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:14.972976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:15.060855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd162daa-d542-4a4d-94c0-76c9949bdd3a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:15.064022 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc1fa77c6074ae4b6c72ceef08d1243'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.075968 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ff822-7137-4418-9836-ce9ddf862761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:15.077019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ff822-7137-4418-9836-ce9ddf862761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:15.077286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ff822-7137-4418-9836-ce9ddf862761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:15.077561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ff822-7137-4418-9836-ce9ddf862761 admin admin] PATH_INFO: `/v3/users/0d8226a06d384a1cae8a5655572f6164` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:15.083086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ff822-7137-4418-9836-ce9ddf862761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8226a06d384a1cae8a5655572f6164)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:15.089707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ff822-7137-4418-9836-ce9ddf862761 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:15.097506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc1fa77c6074ae4b6c72ceef08d1243'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.099652 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc1fa77c6074ae4b6c72ceef08d1243'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.133507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc1fa77c6074ae4b6c72ceef08d1243'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.174946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc1fa77c6074ae4b6c72ceef08d1243'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.201297 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 831/1662] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:14 2021] DELETE /identity/v3/users/7dc1fa77c6074ae4b6c72ceef08d1243 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:15.223096 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:15.225737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:15.263574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-876ff822-7137-4418-9836-ce9ddf862761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8226a06d384a1cae8a5655572f6164'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.301266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-876ff822-7137-4418-9836-ce9ddf862761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8226a06d384a1cae8a5655572f6164'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.319491 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-876ff822-7137-4418-9836-ce9ddf862761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8226a06d384a1cae8a5655572f6164'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.372199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-876ff822-7137-4418-9836-ce9ddf862761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8226a06d384a1cae8a5655572f6164'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.374289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-876ff822-7137-4418-9836-ce9ddf862761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8226a06d384a1cae8a5655572f6164'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.419110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 832/1663] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:14 2021] DELETE /identity/v3/users/0d8226a06d384a1cae8a5655572f6164 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:48:15.421943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a0d00-c003-413d-af9d-ccd054c33179 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:15.422391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a0d00-c003-413d-af9d-ccd054c33179 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:15.422850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a0d00-c003-413d-af9d-ccd054c33179 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:15.433601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 833/1664] 10.222.0.62 () {54 vars in 960 bytes} [Mon Dec 13 16:48:15 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:48:15.436286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ed59-5fb2-435b-a4f7-aaf32294f638 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:15.436286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ed59-5fb2-435b-a4f7-aaf32294f638 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:15.436801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155ed59-5fb2-435b-a4f7-aaf32294f638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:15.473648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c155ed59-5fb2-435b-a4f7-aaf32294f638 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:15.478623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c155ed59-5fb2-435b-a4f7-aaf32294f638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:15.504924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701adf87-055a-4e94-b74c-bb3e0d05d541 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:15.654587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:15.655782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:15.657657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:15.657974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] PATH_INFO: `/v3/projects/8a4c36f75de14e7a830701e0966f4c73` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:15.658883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 834/1665] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:15.660534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc65652-86a0-44c7-a466-befa8f1da542 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:15.660730 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc65652-86a0-44c7-a466-befa8f1da542 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:15.661008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc65652-86a0-44c7-a466-befa8f1da542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:15.667115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a4c36f75de14e7a830701e0966f4c73)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:15.669154 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:15.717444 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-cbc65652-86a0-44c7-a466-befa8f1da542 None None] MFA Rules not processed for user `02b7187c26dd41bea9f3c2b49de8ef28`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:15.718706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-cbc65652-86a0-44c7-a466-befa8f1da542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:15.809531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a4c36f75de14e7a830701e0966f4c73', 'request_id': 'req-1430e3dd-a123-4342-b647-d84769c3c570'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.826563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a4c36f75de14e7a830701e0966f4c73', 'request_id': 'req-1430e3dd-a123-4342-b647-d84769c3c570'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.834533 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a4c36f75de14e7a830701e0966f4c73', 'request_id': 'req-1430e3dd-a123-4342-b647-d84769c3c570'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.857401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] The token cache is being invalidate because project 8a4c36f75de14e7a830701e0966f4c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:15.857688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.860531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:15.870395 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 832/1666] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:15 2021] DELETE /identity/v3/projects/8a4c36f75de14e7a830701e0966f4c73 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:48:15.870395 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:15.870950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:15.896460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 835/1667] 10.222.0.62 () {58 vars in 1057 bytes} [Mon Dec 13 16:48:15 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:15.898672 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439a093-14da-4eb3-8571-4d3acbeec829 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:15.898968 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439a093-14da-4eb3-8571-4d3acbeec829 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:15.899440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439a093-14da-4eb3-8571-4d3acbeec829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:15.940476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-2439a093-14da-4eb3-8571-4d3acbeec829 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:15.940476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2439a093-14da-4eb3-8571-4d3acbeec829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:16.016501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430e3dd-a123-4342-b647-d84769c3c570 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:16.029507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946dfa84-5d21-4db1-821b-f8d0c18f2afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:16.030289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dfa84-5d21-4db1-821b-f8d0c18f2afb service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:16.031599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dfa84-5d21-4db1-821b-f8d0c18f2afb service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:16.031900 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946dfa84-5d21-4db1-821b-f8d0c18f2afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:16.036558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-946dfa84-5d21-4db1-821b-f8d0c18f2afb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:16.111368 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 836/1668] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:16.112349 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439a093-14da-4eb3-8571-4d3acbeec829 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:16.206444 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dfa84-5d21-4db1-821b-f8d0c18f2afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:16.209084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946dfa84-5d21-4db1-821b-f8d0c18f2afb service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:16.226051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439a093-14da-4eb3-8571-4d3acbeec829 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:16.233591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5353e-87b3-409c-97b4-ce451b791d32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b7187c26dd41bea9f3c2b49de8ef28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:16.234543 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5353e-87b3-409c-97b4-ce451b791d32 service placement] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:16.234917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5353e-87b3-409c-97b4-ce451b791d32 service placement] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:16.235204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5353e-87b3-409c-97b4-ce451b791d32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:16.237927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c1b5353e-87b3-409c-97b4-ce451b791d32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:16.254785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5353e-87b3-409c-97b4-ce451b791d32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:16.257283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5353e-87b3-409c-97b4-ce451b791d32 service placement] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:16.262226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 833/1669] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:16.271184 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a887-e948-4fa8-8fd7-9035f1eb99ea None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:16.272297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 837/1670] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:16 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:16.273239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a887-e948-4fa8-8fd7-9035f1eb99ea None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:16.273724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640a887-e948-4fa8-8fd7-9035f1eb99ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:16.316336 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e640a887-e948-4fa8-8fd7-9035f1eb99ea None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:16.317968 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e640a887-e948-4fa8-8fd7-9035f1eb99ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:16.346820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 834/1671] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:16.356787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5353e-87b3-409c-97b4-ce451b791d32 service placement] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:16.464897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5353e-87b3-409c-97b4-ce451b791d32 service placement] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:16.481323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c996c22-7e27-485b-a772-82f64b8d764d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:16.482061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996c22-7e27-485b-a772-82f64b8d764d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:16.482295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996c22-7e27-485b-a772-82f64b8d764d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:16.482574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c996c22-7e27-485b-a772-82f64b8d764d admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:16.483423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c996c22-7e27-485b-a772-82f64b8d764d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:16.483732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c996c22-7e27-485b-a772-82f64b8d764d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:16.485413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c996c22-7e27-485b-a772-82f64b8d764d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:16.525437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 838/1672] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:16.530174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640a887-e948-4fa8-8fd7-9035f1eb99ea None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:16.545945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640a887-e948-4fa8-8fd7-9035f1eb99ea None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:16.569688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b90aaa-d323-4b3d-9368-b381f5c59ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:16.570421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b90aaa-d323-4b3d-9368-b381f5c59ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:16.570761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b90aaa-d323-4b3d-9368-b381f5c59ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:16.571036 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b90aaa-d323-4b3d-9368-b381f5c59ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:16.571822 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b90aaa-d323-4b3d-9368-b381f5c59ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:16.573896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b90aaa-d323-4b3d-9368-b381f5c59ed4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:16.656645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 835/1673] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:16 2021] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:16.658639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c996c22-7e27-485b-a772-82f64b8d764d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:16.675043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c996c22-7e27-485b-a772-82f64b8d764d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:16.779136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b90aaa-d323-4b3d-9368-b381f5c59ed4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:16.781623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-65b90aaa-d323-4b3d-9368-b381f5c59ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:16.866103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7c89-fcea-4230-a7a1-2c4dc30f0f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:16.867127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7c89-fcea-4230-a7a1-2c4dc30f0f87 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:16.869112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7c89-fcea-4230-a7a1-2c4dc30f0f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:16.869590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b7c89-fcea-4230-a7a1-2c4dc30f0f87 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:16.871642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b7c89-fcea-4230-a7a1-2c4dc30f0f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:16.875403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b7c89-fcea-4230-a7a1-2c4dc30f0f87 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:16.964653 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 839/1674] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:16 2021] POST /identity/v3/users => generated 286 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:48:16.968668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7c89-fcea-4230-a7a1-2c4dc30f0f87 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:16.996126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b7c89-fcea-4230-a7a1-2c4dc30f0f87 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:17.005788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183159e-429a-4ddc-b529-99b0162daf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:17.007792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183159e-429a-4ddc-b529-99b0162daf88 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:17.008297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183159e-429a-4ddc-b529-99b0162daf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:17.008911 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183159e-429a-4ddc-b529-99b0162daf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:17.010099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183159e-429a-4ddc-b529-99b0162daf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:17.012866 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183159e-429a-4ddc-b529-99b0162daf88 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:17.033272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 840/1675] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:16 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:17.038300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183159e-429a-4ddc-b529-99b0162daf88 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:17.043023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b90aaa-d323-4b3d-9368-b381f5c59ed4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:17.056236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:17.060160 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:17.060451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:17.060760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] PATH_INFO: `/v3/projects/cc6a1d3036e54ffb8431b2b6832e0453` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:17.064387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc6a1d3036e54ffb8431b2b6832e0453)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:17.072461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:17.091581 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183159e-429a-4ddc-b529-99b0162daf88 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:17.099452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4611-217f-4270-810f-1553ab60d91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:17.100658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4611-217f-4270-810f-1553ab60d91c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:17.101156 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4611-217f-4270-810f-1553ab60d91c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:17.101635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e4611-217f-4270-810f-1553ab60d91c admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:17.102677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4611-217f-4270-810f-1553ab60d91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:17.105235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e4611-217f-4270-810f-1553ab60d91c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:17.143391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 841/1676] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:17 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:17.145897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4611-217f-4270-810f-1553ab60d91c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:17.210259 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e4611-217f-4270-810f-1553ab60d91c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:17.239106 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc6a1d3036e54ffb8431b2b6832e0453', 'request_id': 'req-cb213aa1-205a-47c9-a993-8c4efa472315'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:17.263418 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc6a1d3036e54ffb8431b2b6832e0453', 'request_id': 'req-cb213aa1-205a-47c9-a993-8c4efa472315'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:17.290295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc6a1d3036e54ffb8431b2b6832e0453', 'request_id': 'req-cb213aa1-205a-47c9-a993-8c4efa472315'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:17.327274 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] The token cache is being invalidate because project cc6a1d3036e54ffb8431b2b6832e0453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:17.327569 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:17.328870 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:17.333580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 836/1677] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:16 2021] DELETE /identity/v3/projects/cc6a1d3036e54ffb8431b2b6832e0453 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:17.334457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:17.340033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:17.435331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33388d7b-2663-4573-9589-57eb3473469b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:17.436423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33388d7b-2663-4573-9589-57eb3473469b admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:17.436885 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33388d7b-2663-4573-9589-57eb3473469b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:17.437445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33388d7b-2663-4573-9589-57eb3473469b admin admin] PATH_INFO: `/v3/projects/386665a7d3c54590817d6a4be1522be7/users/6ee83b8748314f7c9ac62d4414c8385f/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:17.478750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33388d7b-2663-4573-9589-57eb3473469b admin admin] RBAC: Authorizing `identity:create_grant(project_id=386665a7d3c54590817d6a4be1522be7, user_id=6ee83b8748314f7c9ac62d4414c8385f, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:17.481839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33388d7b-2663-4573-9589-57eb3473469b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:17.512902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 842/1678] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:17 2021] PUT /identity/v3/projects/386665a7d3c54590817d6a4be1522be7/users/6ee83b8748314f7c9ac62d4414c8385f/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:17.514697 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff407e47-8c14-4d81-b29d-b36fd509bfb5 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:17.515236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff407e47-8c14-4d81-b29d-b36fd509bfb5 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:17.515834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff407e47-8c14-4d81-b29d-b36fd509bfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:17.579937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-ff407e47-8c14-4d81-b29d-b36fd509bfb5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:17.581608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ff407e47-8c14-4d81-b29d-b36fd509bfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:17.645303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb213aa1-205a-47c9-a993-8c4efa472315 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:17.787015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:17.788227 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:17.788690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:17.789131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] PATH_INFO: `/v3/projects/162eec3f3527494a8bd4de1d5583a384` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:17.791216 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=162eec3f3527494a8bd4de1d5583a384)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:17.793863 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:17.829220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 843/1679] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:17.854039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d00ad-256a-4254-9e96-6711ad7bd799 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:17.865916 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d00ad-256a-4254-9e96-6711ad7bd799 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:17.866428 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d00ad-256a-4254-9e96-6711ad7bd799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:17.977947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-0e1d00ad-256a-4254-9e96-6711ad7bd799 None None] MFA Rules not processed for user `6ee83b8748314f7c9ac62d4414c8385f`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:17.983787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0e1d00ad-256a-4254-9e96-6711ad7bd799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:17.985129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162eec3f3527494a8bd4de1d5583a384', 'request_id': 'req-d0c9af56-b51c-46b3-b028-f0d3d4974f18'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:18.009031 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162eec3f3527494a8bd4de1d5583a384', 'request_id': 'req-d0c9af56-b51c-46b3-b028-f0d3d4974f18'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:18.038333 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162eec3f3527494a8bd4de1d5583a384', 'request_id': 'req-d0c9af56-b51c-46b3-b028-f0d3d4974f18'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:18.081000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] The token cache is being invalidate because project 162eec3f3527494a8bd4de1d5583a384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:18.085138 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:18.090231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d0c9af56-b51c-46b3-b028-f0d3d4974f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:18.094289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 837/1680] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:17 2021] DELETE /identity/v3/projects/162eec3f3527494a8bd4de1d5583a384 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:18.099506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ba453-3dc2-4fae-805e-9d9cae74e363 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:18.102289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ba453-3dc2-4fae-805e-9d9cae74e363 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:18.104170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ba453-3dc2-4fae-805e-9d9cae74e363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:18.172272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-967ba453-3dc2-4fae-805e-9d9cae74e363 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:18.191696 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-967ba453-3dc2-4fae-805e-9d9cae74e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:18.252012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 844/1681] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:17 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:18.257377 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a653844-8750-489e-958c-01fa1eadea0d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:18.260846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a653844-8750-489e-958c-01fa1eadea0d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:18.261240 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a653844-8750-489e-958c-01fa1eadea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:18.326821 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-6a653844-8750-489e-958c-01fa1eadea0d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:18.338445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6a653844-8750-489e-958c-01fa1eadea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:18.381303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 838/1682] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:18.385244 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ba453-3dc2-4fae-805e-9d9cae74e363 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:18.387540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-967ba453-3dc2-4fae-805e-9d9cae74e363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:18.412623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ba453-3dc2-4fae-805e-9d9cae74e363 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:18.430250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb705fe-112a-46ce-9dc4-fd6c5fb70972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:18.432140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb705fe-112a-46ce-9dc4-fd6c5fb70972 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:18.433869 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb705fe-112a-46ce-9dc4-fd6c5fb70972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:18.434269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb705fe-112a-46ce-9dc4-fd6c5fb70972 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:18.438367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb705fe-112a-46ce-9dc4-fd6c5fb70972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:18.446087 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb705fe-112a-46ce-9dc4-fd6c5fb70972 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:18.493483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 845/1683] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:18.503889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a653844-8750-489e-958c-01fa1eadea0d None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:18.508919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 839/1684] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:18 2021] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:18.512064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb2ed8-3cbe-406b-b9a8-ee13b43fa371 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:18.513049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb2ed8-3cbe-406b-b9a8-ee13b43fa371 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:18.513049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb2ed8-3cbe-406b-b9a8-ee13b43fa371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:18.526199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a653844-8750-489e-958c-01fa1eadea0d None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:18.558338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-fafb2ed8-3cbe-406b-b9a8-ee13b43fa371 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:18.561896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fafb2ed8-3cbe-406b-b9a8-ee13b43fa371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:18.669035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 840/1685] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:18.670681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb2ed8-3cbe-406b-b9a8-ee13b43fa371 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:18.695864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb2ed8-3cbe-406b-b9a8-ee13b43fa371 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:18.709862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46fe92-26df-4525-8c63-16d008d8568a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:18.711301 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46fe92-26df-4525-8c63-16d008d8568a admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:18.711873 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46fe92-26df-4525-8c63-16d008d8568a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:18.712422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46fe92-26df-4525-8c63-16d008d8568a admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:18.712778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee852c51-01b0-4e98-af46-df12a24b3e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:18.713960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46fe92-26df-4525-8c63-16d008d8568a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:18.714401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee852c51-01b0-4e98-af46-df12a24b3e8d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:18.715059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee852c51-01b0-4e98-af46-df12a24b3e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:18.715677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee852c51-01b0-4e98-af46-df12a24b3e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:18.717402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee852c51-01b0-4e98-af46-df12a24b3e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:18.718192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee852c51-01b0-4e98-af46-df12a24b3e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:18.719776 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46fe92-26df-4525-8c63-16d008d8568a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:18.727951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee852c51-01b0-4e98-af46-df12a24b3e8d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:18.766648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 846/1686] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:18.768031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee852c51-01b0-4e98-af46-df12a24b3e8d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:18.781146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 841/1687] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:18 2021] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:18.783412 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46fe92-26df-4525-8c63-16d008d8568a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:18.789931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee852c51-01b0-4e98-af46-df12a24b3e8d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:18.802456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094277d-0aaf-4fcf-961b-268ced6ae75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:18.804175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46fe92-26df-4525-8c63-16d008d8568a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:18.805102 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094277d-0aaf-4fcf-961b-268ced6ae75f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:18.805559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094277d-0aaf-4fcf-961b-268ced6ae75f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:18.805993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094277d-0aaf-4fcf-961b-268ced6ae75f admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:18.808715 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094277d-0aaf-4fcf-961b-268ced6ae75f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:18.809773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094277d-0aaf-4fcf-961b-268ced6ae75f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:18.813757 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094277d-0aaf-4fcf-961b-268ced6ae75f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:18.819303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698424-ba70-45e1-a4d6-3bed8ffc58e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:18.820242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698424-ba70-45e1-a4d6-3bed8ffc58e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:18.820701 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698424-ba70-45e1-a4d6-3bed8ffc58e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:18.821825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698424-ba70-45e1-a4d6-3bed8ffc58e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:18.822756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac698424-ba70-45e1-a4d6-3bed8ffc58e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:18.830266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac698424-ba70-45e1-a4d6-3bed8ffc58e1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:18.851344 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 847/1688] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:18.853165 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094277d-0aaf-4fcf-961b-268ced6ae75f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:18.874626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094277d-0aaf-4fcf-961b-268ced6ae75f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:18.901431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a64c3f-b3a2-4e9a-9814-42eed5b54339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:18.902021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 842/1689] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:18 2021] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:18.903004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a64c3f-b3a2-4e9a-9814-42eed5b54339 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:18.904026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698424-ba70-45e1-a4d6-3bed8ffc58e1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:18.904508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a64c3f-b3a2-4e9a-9814-42eed5b54339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:18.906323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a64c3f-b3a2-4e9a-9814-42eed5b54339 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:18.910498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a64c3f-b3a2-4e9a-9814-42eed5b54339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:18.912191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a64c3f-b3a2-4e9a-9814-42eed5b54339 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:18.941329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 848/1690] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:18 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:18.941904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a64c3f-b3a2-4e9a-9814-42eed5b54339 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:18.970334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a64c3f-b3a2-4e9a-9814-42eed5b54339 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:18.993858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698424-ba70-45e1-a4d6-3bed8ffc58e1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:18.999328 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc59d26-6479-4ff5-a232-97688c8b9098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:19.000003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc59d26-6479-4ff5-a232-97688c8b9098 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:19.000280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc59d26-6479-4ff5-a232-97688c8b9098 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:19.001243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc59d26-6479-4ff5-a232-97688c8b9098 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:19.001955 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc59d26-6479-4ff5-a232-97688c8b9098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:19.004628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc59d26-6479-4ff5-a232-97688c8b9098 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:19.053961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 843/1691] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:18 2021] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:19.056175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc59d26-6479-4ff5-a232-97688c8b9098 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:19.114353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ae695-37c3-480b-ae82-d584ca94d9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:19.115197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ae695-37c3-480b-ae82-d584ca94d9e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:19.115548 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ae695-37c3-480b-ae82-d584ca94d9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:19.115926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ae695-37c3-480b-ae82-d584ca94d9e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:19.116791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ae695-37c3-480b-ae82-d584ca94d9e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:19.122785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ae695-37c3-480b-ae82-d584ca94d9e7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:19.175617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 849/1692] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:18 2021] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:19.175617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ae695-37c3-480b-ae82-d584ca94d9e7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:19.200464 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ae695-37c3-480b-ae82-d584ca94d9e7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:19.374632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc59d26-6479-4ff5-a232-97688c8b9098 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:19.405716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14897984-85cb-4f27-b5bf-f1da1d6d2367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:19.407408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14897984-85cb-4f27-b5bf-f1da1d6d2367 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:19.407408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14897984-85cb-4f27-b5bf-f1da1d6d2367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:19.412334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d7fd8-a734-440b-aebc-db8a30beeeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:19.418023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14897984-85cb-4f27-b5bf-f1da1d6d2367 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:19.419611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d7fd8-a734-440b-aebc-db8a30beeeb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:19.420724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14897984-85cb-4f27-b5bf-f1da1d6d2367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:19.421100 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d7fd8-a734-440b-aebc-db8a30beeeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:19.421499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d7fd8-a734-440b-aebc-db8a30beeeb2 admin admin] PATH_INFO: `/v3/projects/ff06c30d0e07461fb183e0fb7df43276/users/621727917c4c45be8b303b991bb3bbe5/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:19.427635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14897984-85cb-4f27-b5bf-f1da1d6d2367 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:19.447291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d7fd8-a734-440b-aebc-db8a30beeeb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff06c30d0e07461fb183e0fb7df43276, user_id=621727917c4c45be8b303b991bb3bbe5, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:19.456405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d7fd8-a734-440b-aebc-db8a30beeeb2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:19.488388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 844/1693] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:19 2021] PUT /identity/v3/projects/ff06c30d0e07461fb183e0fb7df43276/users/621727917c4c45be8b303b991bb3bbe5/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:19.489732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d7fd8-a734-440b-aebc-db8a30beeeb2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:19.512982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 850/1694] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:19 2021] POST /identity/v3/users => generated 286 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:19.516855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14897984-85cb-4f27-b5bf-f1da1d6d2367 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:19.563345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14897984-85cb-4f27-b5bf-f1da1d6d2367 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:19.660238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d7fd8-a734-440b-aebc-db8a30beeeb2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:19.684152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001461a6-0fc0-413d-8380-0f165bd78946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:19.685502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001461a6-0fc0-413d-8380-0f165bd78946 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:19.685956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001461a6-0fc0-413d-8380-0f165bd78946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:19.686395 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001461a6-0fc0-413d-8380-0f165bd78946 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:19.690063 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001461a6-0fc0-413d-8380-0f165bd78946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:19.698314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001461a6-0fc0-413d-8380-0f165bd78946 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:19.700402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3cd5c-c217-497d-81b9-e407f1769989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:19.701345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3cd5c-c217-497d-81b9-e407f1769989 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:19.701797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3cd5c-c217-497d-81b9-e407f1769989 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:19.702243 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3cd5c-c217-497d-81b9-e407f1769989 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:19.703354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3cd5c-c217-497d-81b9-e407f1769989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:19.705404 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3cd5c-c217-497d-81b9-e407f1769989 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:19.730509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 851/1695] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:19 2021] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:19.731750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3cd5c-c217-497d-81b9-e407f1769989 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:19.738841 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 845/1696] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:19 2021] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:19.739864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001461a6-0fc0-413d-8380-0f165bd78946 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:19.743625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3cd5c-c217-497d-81b9-e407f1769989 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:19.749285 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0be704-32da-44b0-9bbb-88ac108e3e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:19.750441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0be704-32da-44b0-9bbb-88ac108e3e6a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:19.750878 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0be704-32da-44b0-9bbb-88ac108e3e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:19.751294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0be704-32da-44b0-9bbb-88ac108e3e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:19.752213 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0be704-32da-44b0-9bbb-88ac108e3e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:19.754206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0be704-32da-44b0-9bbb-88ac108e3e6a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:19.769588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001461a6-0fc0-413d-8380-0f165bd78946 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:19.770467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 852/1697] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:19 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:19.771767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0be704-32da-44b0-9bbb-88ac108e3e6a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:19.783264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0be704-32da-44b0-9bbb-88ac108e3e6a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:19.785489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b98b0-e8e5-4c86-bfff-9ba0357dc3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:19.786429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b98b0-e8e5-4c86-bfff-9ba0357dc3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:19.786708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b98b0-e8e5-4c86-bfff-9ba0357dc3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:19.786989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b98b0-e8e5-4c86-bfff-9ba0357dc3f7 admin admin] PATH_INFO: `/v3/projects/ff06c30d0e07461fb183e0fb7df43276/users/621727917c4c45be8b303b991bb3bbe5/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:19.789459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b98b0-e8e5-4c86-bfff-9ba0357dc3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff06c30d0e07461fb183e0fb7df43276, user_id=621727917c4c45be8b303b991bb3bbe5, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:19.790217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4699d6-6299-45af-bbc8-585cd6244eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:19.791116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4699d6-6299-45af-bbc8-585cd6244eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:19.791555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4699d6-6299-45af-bbc8-585cd6244eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:19.791969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4699d6-6299-45af-bbc8-585cd6244eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:19.792168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b98b0-e8e5-4c86-bfff-9ba0357dc3f7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:19.793091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4699d6-6299-45af-bbc8-585cd6244eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:19.794867 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4699d6-6299-45af-bbc8-585cd6244eb8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:19.808731 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 853/1698] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:19 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:19.810029 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4699d6-6299-45af-bbc8-585cd6244eb8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:19.825331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4699d6-6299-45af-bbc8-585cd6244eb8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:19.832895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 846/1699] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:19 2021] PUT /identity/v3/projects/ff06c30d0e07461fb183e0fb7df43276/users/621727917c4c45be8b303b991bb3bbe5/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:19.833674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b98b0-e8e5-4c86-bfff-9ba0357dc3f7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:19.894570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76d803-c550-40bc-b1a6-98b803d35d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:19.895602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76d803-c550-40bc-b1a6-98b803d35d08 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:19.896045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76d803-c550-40bc-b1a6-98b803d35d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:19.896470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76d803-c550-40bc-b1a6-98b803d35d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:19.897549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76d803-c550-40bc-b1a6-98b803d35d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:19.899350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76d803-c550-40bc-b1a6-98b803d35d08 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:19.915012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 854/1700] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:19 2021] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:19.916998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026dc9-5375-4eb5-a716-c7097452d388 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:19.917677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026dc9-5375-4eb5-a716-c7097452d388 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:19.918181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63026dc9-5375-4eb5-a716-c7097452d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:19.948801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-63026dc9-5375-4eb5-a716-c7097452d388 None None] MFA Rules not processed for user `621727917c4c45be8b303b991bb3bbe5`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:19.951113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-63026dc9-5375-4eb5-a716-c7097452d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:19.975529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b98b0-e8e5-4c86-bfff-9ba0357dc3f7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:19.997861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2adcc0-32b2-43e2-a661-dc7b1681e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:19.999915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2adcc0-32b2-43e2-a661-dc7b1681e00c admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:20.000231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2adcc0-32b2-43e2-a661-dc7b1681e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:20.001071 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2adcc0-32b2-43e2-a661-dc7b1681e00c admin admin] PATH_INFO: `/v3/projects/6d6e5913d00e4fcf9fd804cf7314614b/users/93a0a8bd61c846e5b996fc161605e94e/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:20.031777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2adcc0-32b2-43e2-a661-dc7b1681e00c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e5913d00e4fcf9fd804cf7314614b, user_id=93a0a8bd61c846e5b996fc161605e94e, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:20.034662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2adcc0-32b2-43e2-a661-dc7b1681e00c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:20.045255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 855/1701] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:19 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:20.046641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63026dc9-5375-4eb5-a716-c7097452d388 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:20.065826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63026dc9-5375-4eb5-a716-c7097452d388 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:20.081650 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 847/1702] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:19 2021] PUT /identity/v3/projects/6d6e5913d00e4fcf9fd804cf7314614b/users/93a0a8bd61c846e5b996fc161605e94e/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:20.083045 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2adcc0-32b2-43e2-a661-dc7b1681e00c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:20.093486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-8b2adcc0-32b2-43e2-a661-dc7b1681e00c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:20.160397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a87389-3ae8-4a75-bd70-e0437a374a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:20.161043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2adcc0-32b2-43e2-a661-dc7b1681e00c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:20.163704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a87389-3ae8-4a75-bd70-e0437a374a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:20.165097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a87389-3ae8-4a75-bd70-e0437a374a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:20.165369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49379f-7c50-4eaa-a0fd-29f515adccdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:20.165902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a87389-3ae8-4a75-bd70-e0437a374a26 admin admin] PATH_INFO: `/v3/projects/480c1ef598024185872b86bbe83a09a9/users/8d2bdd56622a49b9ac80f181d5f3ae36/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:20.166021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49379f-7c50-4eaa-a0fd-29f515adccdc service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:20.166310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49379f-7c50-4eaa-a0fd-29f515adccdc service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:20.166584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49379f-7c50-4eaa-a0fd-29f515adccdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:20.202076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a87389-3ae8-4a75-bd70-e0437a374a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=480c1ef598024185872b86bbe83a09a9, user_id=8d2bdd56622a49b9ac80f181d5f3ae36, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:20.207583 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a87389-3ae8-4a75-bd70-e0437a374a26 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:20.239750 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49379f-7c50-4eaa-a0fd-29f515adccdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:20.250532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49379f-7c50-4eaa-a0fd-29f515adccdc service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:20.251184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 856/1703] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:20 2021] PUT /identity/v3/projects/480c1ef598024185872b86bbe83a09a9/users/8d2bdd56622a49b9ac80f181d5f3ae36/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:20.253828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f6627-a55c-4503-a90b-fb09064bc489 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:20.254954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 848/1704] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:20 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:20.256184 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49379f-7c50-4eaa-a0fd-29f515adccdc service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:20.257638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1a49379f-7c50-4eaa-a0fd-29f515adccdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:20.284244 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49379f-7c50-4eaa-a0fd-29f515adccdc service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:20.288431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f6627-a55c-4503-a90b-fb09064bc489 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:20.293514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f6627-a55c-4503-a90b-fb09064bc489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:20.375011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dbba4-f0fd-4f68-a56d-3f8606bfdd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:20.376114 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dbba4-f0fd-4f68-a56d-3f8606bfdd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:20.377857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dbba4-f0fd-4f68-a56d-3f8606bfdd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:20.377857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dbba4-f0fd-4f68-a56d-3f8606bfdd16 admin admin] PATH_INFO: `/v3/users/956e41eae5f24c328f1cb8a8efffa5c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:20.382273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dbba4-f0fd-4f68-a56d-3f8606bfdd16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956e41eae5f24c328f1cb8a8efffa5c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:20.386481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dbba4-f0fd-4f68-a56d-3f8606bfdd16 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:20.472036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-358f6627-a55c-4503-a90b-fb09064bc489 None None] MFA Rules not processed for user `93a0a8bd61c846e5b996fc161605e94e`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:20.477463 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-358f6627-a55c-4503-a90b-fb09064bc489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:20.489017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-351dbba4-f0fd-4f68-a56d-3f8606bfdd16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956e41eae5f24c328f1cb8a8efffa5c5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:20.514059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-351dbba4-f0fd-4f68-a56d-3f8606bfdd16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956e41eae5f24c328f1cb8a8efffa5c5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:20.514854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-351dbba4-f0fd-4f68-a56d-3f8606bfdd16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956e41eae5f24c328f1cb8a8efffa5c5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:20.529383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-351dbba4-f0fd-4f68-a56d-3f8606bfdd16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956e41eae5f24c328f1cb8a8efffa5c5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:20.567112 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-351dbba4-f0fd-4f68-a56d-3f8606bfdd16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956e41eae5f24c328f1cb8a8efffa5c5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:20.590523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 849/1705] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:20 2021] DELETE /identity/v3/users/956e41eae5f24c328f1cb8a8efffa5c5 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:20.590523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6bc70-7496-40f0-8eec-2d5b8758d61f None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:20.590523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6bc70-7496-40f0-8eec-2d5b8758d61f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:20.590523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6bc70-7496-40f0-8eec-2d5b8758d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:20.647780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-34b6bc70-7496-40f0-8eec-2d5b8758d61f None None] MFA Rules not processed for user `8d2bdd56622a49b9ac80f181d5f3ae36`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:20.650801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-34b6bc70-7496-40f0-8eec-2d5b8758d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:20.777519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 857/1706] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:20 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 521 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:20.777519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f6627-a55c-4503-a90b-fb09064bc489 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:20.780009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-358f6627-a55c-4503-a90b-fb09064bc489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:20.885500 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 850/1707] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:20 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:20.885500 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07957df-085b-4ae5-a6bc-d1fe532ed0b4 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:20.885500 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07957df-085b-4ae5-a6bc-d1fe532ed0b4 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:20.885500 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07957df-085b-4ae5-a6bc-d1fe532ed0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:20.943047 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f6627-a55c-4503-a90b-fb09064bc489 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:20.961789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b07957df-085b-4ae5-a6bc-d1fe532ed0b4 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:20.963380 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b07957df-085b-4ae5-a6bc-d1fe532ed0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:21.059858 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8f51-6f57-4b5d-932f-145bab808c3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:21.060879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8f51-6f57-4b5d-932f-145bab808c3e service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:21.061314 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8f51-6f57-4b5d-932f-145bab808c3e service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:21.061775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b8f51-6f57-4b5d-932f-145bab808c3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:21.065934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-373b8f51-6f57-4b5d-932f-145bab808c3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:21.244858 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b8f51-6f57-4b5d-932f-145bab808c3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:21.249479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b8f51-6f57-4b5d-932f-145bab808c3e service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:21.253383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 851/1708] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:48:20 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:21.256324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07957df-085b-4ae5-a6bc-d1fe532ed0b4 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:21.264960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b07957df-085b-4ae5-a6bc-d1fe532ed0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:21.278032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 858/1709] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:20 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:21.279516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8f51-6f57-4b5d-932f-145bab808c3e service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:21.282184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-373b8f51-6f57-4b5d-932f-145bab808c3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:21.507398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b8f51-6f57-4b5d-932f-145bab808c3e service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:21.520192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd29daf-9e4f-4664-b1f9-994c9a52342b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:21.521315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd29daf-9e4f-4664-b1f9-994c9a52342b admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:21.522446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd29daf-9e4f-4664-b1f9-994c9a52342b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:21.522954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd29daf-9e4f-4664-b1f9-994c9a52342b admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:21.524411 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd29daf-9e4f-4664-b1f9-994c9a52342b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:21.529963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd29daf-9e4f-4664-b1f9-994c9a52342b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:21.620539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 859/1710] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:21 2021] POST /identity/v3/projects => generated 373 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:21.630253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd29daf-9e4f-4664-b1f9-994c9a52342b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:21.675868 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07957df-085b-4ae5-a6bc-d1fe532ed0b4 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:21.794883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd29daf-9e4f-4664-b1f9-994c9a52342b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:21.808991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc253aca-60c5-44c5-a57c-0c2e2176f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:21.809815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc253aca-60c5-44c5-a57c-0c2e2176f0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:21.810633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc253aca-60c5-44c5-a57c-0c2e2176f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:21.810633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc253aca-60c5-44c5-a57c-0c2e2176f0b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:21.811247 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc253aca-60c5-44c5-a57c-0c2e2176f0b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:21.816327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc253aca-60c5-44c5-a57c-0c2e2176f0b5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:21.855117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 860/1711] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:21 2021] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:21.856025 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc253aca-60c5-44c5-a57c-0c2e2176f0b5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:21.866544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-dc253aca-60c5-44c5-a57c-0c2e2176f0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:21.957491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bf188-b09e-4e80-b332-49ed0fdadd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:21.958619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf188-b09e-4e80-b332-49ed0fdadd82 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:21.959104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf188-b09e-4e80-b332-49ed0fdadd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:21.959568 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bf188-b09e-4e80-b332-49ed0fdadd82 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:21.960662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bf188-b09e-4e80-b332-49ed0fdadd82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:21.964140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bf188-b09e-4e80-b332-49ed0fdadd82 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:22.033728 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc253aca-60c5-44c5-a57c-0c2e2176f0b5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:22.055239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8f25-b5e3-49bb-8155-fc21ddf6b0c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:22.056305 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8f25-b5e3-49bb-8155-fc21ddf6b0c2 service swift] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:22.056798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8f25-b5e3-49bb-8155-fc21ddf6b0c2 service swift] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:22.057280 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a8f25-b5e3-49bb-8155-fc21ddf6b0c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:22.069188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 852/1712] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:21 2021] POST /identity/v3/projects => generated 379 bytes in 815 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:22.070648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bf188-b09e-4e80-b332-49ed0fdadd82 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:22.077671 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e44bf188-b09e-4e80-b332-49ed0fdadd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:22.231751 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8f25-b5e3-49bb-8155-fc21ddf6b0c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:22.233586 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a8f25-b5e3-49bb-8155-fc21ddf6b0c2 service swift] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:22.256555 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bf188-b09e-4e80-b332-49ed0fdadd82 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:22.257166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 861/1713] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:48:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:48:22.259207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8f25-b5e3-49bb-8155-fc21ddf6b0c2 service swift] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:22.280049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:22.281682 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:22.282040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:22.282381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] PATH_INFO: `/v3/users/5670565ff02147ec80c0d2cb7fad174b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:22.284481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5670565ff02147ec80c0d2cb7fad174b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:22.291984 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a8f25-b5e3-49bb-8155-fc21ddf6b0c2 service swift] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:22.300348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:22.338057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf162e67-7259-45f3-aab6-ffc7bbd21779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:22.338057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf162e67-7259-45f3-aab6-ffc7bbd21779 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:22.338057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf162e67-7259-45f3-aab6-ffc7bbd21779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:22.338057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf162e67-7259-45f3-aab6-ffc7bbd21779 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:22.338805 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf162e67-7259-45f3-aab6-ffc7bbd21779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:22.343137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf162e67-7259-45f3-aab6-ffc7bbd21779 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:22.405308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 862/1714] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:22 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:22.407143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf162e67-7259-45f3-aab6-ffc7bbd21779 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:22.455700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf162e67-7259-45f3-aab6-ffc7bbd21779 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:22.504869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7fdc3-fc1b-4d52-88e2-49332cdae61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:22.513150 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7fdc3-fc1b-4d52-88e2-49332cdae61c admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:22.513598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7fdc3-fc1b-4d52-88e2-49332cdae61c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:22.514053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7fdc3-fc1b-4d52-88e2-49332cdae61c admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:22.515291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7fdc3-fc1b-4d52-88e2-49332cdae61c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:22.536019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7fdc3-fc1b-4d52-88e2-49332cdae61c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:22.568303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5670565ff02147ec80c0d2cb7fad174b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:22.617760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5670565ff02147ec80c0d2cb7fad174b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:22.619301 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5670565ff02147ec80c0d2cb7fad174b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:22.632612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 863/1715] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:22 2021] POST /identity/v3/users => generated 296 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:22.634292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7fdc3-fc1b-4d52-88e2-49332cdae61c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:22.648937 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5670565ff02147ec80c0d2cb7fad174b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:22.675470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5670565ff02147ec80c0d2cb7fad174b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:22.694225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 853/1716] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:22 2021] DELETE /identity/v3/users/5670565ff02147ec80c0d2cb7fad174b => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:22.696254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:22.704782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:22.706870 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7fdc3-fc1b-4d52-88e2-49332cdae61c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:22.960076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9df7db-72c9-4004-bb11-57c309542128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:22.961308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df7db-72c9-4004-bb11-57c309542128 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:22.961601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df7db-72c9-4004-bb11-57c309542128 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:22.961926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9df7db-72c9-4004-bb11-57c309542128 admin admin] PATH_INFO: `/v3/projects/cfe6568947f44c95a74c06100e9070e8/users/485559bcb2e347c6b8c1328158ea3677/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:22.969651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e7808-1172-4e23-b1f4-59cb92a8ce2a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:22.995948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af394099-8123-46aa-bbb4-c27302885143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:22.997358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af394099-8123-46aa-bbb4-c27302885143 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:22.997765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af394099-8123-46aa-bbb4-c27302885143 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:22.998829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af394099-8123-46aa-bbb4-c27302885143 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:22.999817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af394099-8123-46aa-bbb4-c27302885143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:23.003717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af394099-8123-46aa-bbb4-c27302885143 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:23.023648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 854/1717] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:22 2021] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:23.025598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f2b4a-7601-4b26-85c2-54ffa22643bb None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:23.026037 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f2b4a-7601-4b26-85c2-54ffa22643bb None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:23.026414 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f2b4a-7601-4b26-85c2-54ffa22643bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:23.030833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9df7db-72c9-4004-bb11-57c309542128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe6568947f44c95a74c06100e9070e8, user_id=485559bcb2e347c6b8c1328158ea3677, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:23.035191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9df7db-72c9-4004-bb11-57c309542128 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:23.054474 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-f29f2b4a-7601-4b26-85c2-54ffa22643bb None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:23.056242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f29f2b4a-7601-4b26-85c2-54ffa22643bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:23.066825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 855/1718] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:23.068224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f2b4a-7601-4b26-85c2-54ffa22643bb None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:23.094698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f2b4a-7601-4b26-85c2-54ffa22643bb None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:23.124360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 864/1719] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:22 2021] PUT /identity/v3/projects/cfe6568947f44c95a74c06100e9070e8/users/485559bcb2e347c6b8c1328158ea3677/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:23.130286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9df7db-72c9-4004-bb11-57c309542128 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:23.149961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-cc9df7db-72c9-4004-bb11-57c309542128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:23.247018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ad2e7-8bd7-4410-b55f-bdbe935f9a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:23.249765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ad2e7-8bd7-4410-b55f-bdbe935f9a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:23.250066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ad2e7-8bd7-4410-b55f-bdbe935f9a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:23.250390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ad2e7-8bd7-4410-b55f-bdbe935f9a45 admin admin] PATH_INFO: `/v3/projects/124e2e3cc77c438696f1abea3bf1a7d8/users/cd63559e253141e3986b79b165d78f31/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:23.289853 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ad2e7-8bd7-4410-b55f-bdbe935f9a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124e2e3cc77c438696f1abea3bf1a7d8, user_id=cd63559e253141e3986b79b165d78f31, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:23.295423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133ad2e7-8bd7-4410-b55f-bdbe935f9a45 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:23.348559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 856/1720] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:23 2021] PUT /identity/v3/projects/124e2e3cc77c438696f1abea3bf1a7d8/users/cd63559e253141e3986b79b165d78f31/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:23.350811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ad2e7-8bd7-4410-b55f-bdbe935f9a45 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:23.358335 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-133ad2e7-8bd7-4410-b55f-bdbe935f9a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:23.378216 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9df7db-72c9-4004-bb11-57c309542128 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:23.535758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ad2e7-8bd7-4410-b55f-bdbe935f9a45 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:23.551344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:23.553291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:23.554140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:23.556313 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] PATH_INFO: `/v3/projects/163dbcd4f38c42c7b86df6d0040185b0` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:23.560749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=163dbcd4f38c42c7b86df6d0040185b0)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:23.570954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:23.588800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b6dd8-8440-4112-ba77-fc0252b849e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:23.589637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b6dd8-8440-4112-ba77-fc0252b849e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:23.590021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b6dd8-8440-4112-ba77-fc0252b849e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:23.590396 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b6dd8-8440-4112-ba77-fc0252b849e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:23.591724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b6dd8-8440-4112-ba77-fc0252b849e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:23.594591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b6dd8-8440-4112-ba77-fc0252b849e5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:23.655006 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 865/1721] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:23 2021] GET /identity/v3/roles => generated 1420 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:23.658390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b6dd8-8440-4112-ba77-fc0252b849e5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:23.666842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-228b6dd8-8440-4112-ba77-fc0252b849e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:23.689737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163dbcd4f38c42c7b86df6d0040185b0', 'request_id': 'req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:23.722075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163dbcd4f38c42c7b86df6d0040185b0', 'request_id': 'req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:23.737669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163dbcd4f38c42c7b86df6d0040185b0', 'request_id': 'req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:23.768207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] The token cache is being invalidate because project 163dbcd4f38c42c7b86df6d0040185b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:23.768695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:23.770450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:23.772449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 857/1722] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:23 2021] DELETE /identity/v3/projects/163dbcd4f38c42c7b86df6d0040185b0 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:23.774448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:23.778801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:23.929712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b6dd8-8440-4112-ba77-fc0252b849e5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:24.136008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bb5a0-6f2a-4fa8-a040-f4a2c0f3d2ab admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:24.175089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10253b7d-fff6-43e4-b817-734f1a849e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:24.182352 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10253b7d-fff6-43e4-b817-734f1a849e5e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:24.192273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10253b7d-fff6-43e4-b817-734f1a849e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:24.197345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10253b7d-fff6-43e4-b817-734f1a849e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:24.205976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10253b7d-fff6-43e4-b817-734f1a849e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:24.225470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10253b7d-fff6-43e4-b817-734f1a849e5e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:24.341370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 858/1723] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:23 2021] GET /identity/v3/roles => generated 1420 bytes in 567 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:24.352377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10253b7d-fff6-43e4-b817-734f1a849e5e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:24.363940 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-10253b7d-fff6-43e4-b817-734f1a849e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:24.367311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd01c50-bcd5-4132-ba58-37172e4ecd7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:24.371529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd01c50-bcd5-4132-ba58-37172e4ecd7c service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:24.373983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd01c50-bcd5-4132-ba58-37172e4ecd7c service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:24.375600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd01c50-bcd5-4132-ba58-37172e4ecd7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:24.397792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fcd01c50-bcd5-4132-ba58-37172e4ecd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:24.426197 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10253b7d-fff6-43e4-b817-734f1a849e5e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:24.440100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd01c50-bcd5-4132-ba58-37172e4ecd7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:24.445176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd01c50-bcd5-4132-ba58-37172e4ecd7c service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:24.447109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64329847-4f59-404d-a698-45374e56c6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:24.451746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64329847-4f59-404d-a698-45374e56c6bf admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:24.452551 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64329847-4f59-404d-a698-45374e56c6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:24.455333 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64329847-4f59-404d-a698-45374e56c6bf admin admin] PATH_INFO: `/v3/projects/cfe6568947f44c95a74c06100e9070e8/users/485559bcb2e347c6b8c1328158ea3677/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:24.474581 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64329847-4f59-404d-a698-45374e56c6bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe6568947f44c95a74c06100e9070e8, user_id=485559bcb2e347c6b8c1328158ea3677, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:24.488714 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64329847-4f59-404d-a698-45374e56c6bf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:24.513876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 866/1724] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 857 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:24.518241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd01c50-bcd5-4132-ba58-37172e4ecd7c service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:24.526118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fcd01c50-bcd5-4132-ba58-37172e4ecd7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:24.554175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 859/1725] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:24 2021] PUT /identity/v3/projects/cfe6568947f44c95a74c06100e9070e8/users/485559bcb2e347c6b8c1328158ea3677/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:24.561104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64329847-4f59-404d-a698-45374e56c6bf admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:24.615290 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd01c50-bcd5-4132-ba58-37172e4ecd7c service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:24.889572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64329847-4f59-404d-a698-45374e56c6bf admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:24.892098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76a3e3-fef7-4fb3-a58b-1744e6f6ec68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:24.894088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76a3e3-fef7-4fb3-a58b-1744e6f6ec68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:24.894842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76a3e3-fef7-4fb3-a58b-1744e6f6ec68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:24.895391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76a3e3-fef7-4fb3-a58b-1744e6f6ec68 admin admin] PATH_INFO: `/v3/users/03741fc45fac4c7982a059ec22d12037` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:24.898174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76a3e3-fef7-4fb3-a58b-1744e6f6ec68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03741fc45fac4c7982a059ec22d12037)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:24.906547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abec65-76cf-4126-9fb8-7f8f203f3c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:24.907987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abec65-76cf-4126-9fb8-7f8f203f3c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:24.908403 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abec65-76cf-4126-9fb8-7f8f203f3c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:24.908859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abec65-76cf-4126-9fb8-7f8f203f3c63 admin admin] PATH_INFO: `/v3/projects/124e2e3cc77c438696f1abea3bf1a7d8/users/cd63559e253141e3986b79b165d78f31/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:24.909777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76a3e3-fef7-4fb3-a58b-1744e6f6ec68 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:24.916174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abec65-76cf-4126-9fb8-7f8f203f3c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124e2e3cc77c438696f1abea3bf1a7d8, user_id=cd63559e253141e3986b79b165d78f31, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:24.927702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abec65-76cf-4126-9fb8-7f8f203f3c63 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:24.966183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 860/1726] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:24 2021] PUT /identity/v3/projects/124e2e3cc77c438696f1abea3bf1a7d8/users/cd63559e253141e3986b79b165d78f31/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:24.968350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598e539-203c-4f34-9dcd-55f86472dbb4 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:24.968793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598e539-203c-4f34-9dcd-55f86472dbb4 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:24.969209 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598e539-203c-4f34-9dcd-55f86472dbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:25.054368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-f598e539-203c-4f34-9dcd-55f86472dbb4 None None] MFA Rules not processed for user `485559bcb2e347c6b8c1328158ea3677`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:25.055640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f598e539-203c-4f34-9dcd-55f86472dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:25.085285 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ee76a3e3-fef7-4fb3-a58b-1744e6f6ec68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03741fc45fac4c7982a059ec22d12037'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:25.153897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ee76a3e3-fef7-4fb3-a58b-1744e6f6ec68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03741fc45fac4c7982a059ec22d12037'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:25.168812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ee76a3e3-fef7-4fb3-a58b-1744e6f6ec68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03741fc45fac4c7982a059ec22d12037'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:25.207021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ee76a3e3-fef7-4fb3-a58b-1744e6f6ec68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03741fc45fac4c7982a059ec22d12037'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:25.208266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ee76a3e3-fef7-4fb3-a58b-1744e6f6ec68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03741fc45fac4c7982a059ec22d12037'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:25.240927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 867/1727] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:24 2021] DELETE /identity/v3/users/03741fc45fac4c7982a059ec22d12037 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:25.251179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726aaf0e-4f4e-4f63-a991-2fee14731f28 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:25.253137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726aaf0e-4f4e-4f63-a991-2fee14731f28 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:25.254776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726aaf0e-4f4e-4f63-a991-2fee14731f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:25.364357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-726aaf0e-4f4e-4f63-a991-2fee14731f28 None None] MFA Rules not processed for user `cd63559e253141e3986b79b165d78f31`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:25.364964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 861/1728] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:24 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:25.379350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598e539-203c-4f34-9dcd-55f86472dbb4 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:25.382239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-726aaf0e-4f4e-4f63-a991-2fee14731f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:25.383394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f598e539-203c-4f34-9dcd-55f86472dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:25.670242 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 868/1729] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:25 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:25.682483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726aaf0e-4f4e-4f63-a991-2fee14731f28 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:25.689046 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-726aaf0e-4f4e-4f63-a991-2fee14731f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:25.866297 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598e539-203c-4f34-9dcd-55f86472dbb4 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:25.977257 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726aaf0e-4f4e-4f63-a991-2fee14731f28 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:25.995811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec5d29-417b-433b-b991-f4b7316b7fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:25.996811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5d29-417b-433b-b991-f4b7316b7fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:25.997091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5d29-417b-433b-b991-f4b7316b7fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:25.997363 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5d29-417b-433b-b991-f4b7316b7fc3 admin admin] PATH_INFO: `/v3/users/93a0a8bd61c846e5b996fc161605e94e` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:25.999153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec5d29-417b-433b-b991-f4b7316b7fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a0a8bd61c846e5b996fc161605e94e)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:26.008868 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec5d29-417b-433b-b991-f4b7316b7fc3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:26.126499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d4f7d-a549-40b8-b71d-b46fa1465a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:26.127270 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d4f7d-a549-40b8-b71d-b46fa1465a34 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:26.127451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d4f7d-a549-40b8-b71d-b46fa1465a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:26.127731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d4f7d-a549-40b8-b71d-b46fa1465a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:26.137600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-14ec5d29-417b-433b-b991-f4b7316b7fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a0a8bd61c846e5b996fc161605e94e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:26.179849 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-14ec5d29-417b-433b-b991-f4b7316b7fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a0a8bd61c846e5b996fc161605e94e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:26.200081 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-14ec5d29-417b-433b-b991-f4b7316b7fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a0a8bd61c846e5b996fc161605e94e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:26.224170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-14ec5d29-417b-433b-b991-f4b7316b7fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a0a8bd61c846e5b996fc161605e94e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:26.227610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-14ec5d29-417b-433b-b991-f4b7316b7fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a0a8bd61c846e5b996fc161605e94e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:26.281540 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 869/1730] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:25 2021] DELETE /identity/v3/users/93a0a8bd61c846e5b996fc161605e94e => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:26.285804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55538-3f25-441f-9e99-9770528d47f2 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:26.290023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55538-3f25-441f-9e99-9770528d47f2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:26.290865 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d55538-3f25-441f-9e99-9770528d47f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:26.391380 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d4f7d-a549-40b8-b71d-b46fa1465a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:26.394696 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d4f7d-a549-40b8-b71d-b46fa1465a34 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:26.451610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c7d55538-3f25-441f-9e99-9770528d47f2 None None] MFA Rules not processed for user `c282fd140f5645ca89c2e64888ea1345`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:26.453289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c7d55538-3f25-441f-9e99-9770528d47f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:26.464827 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 862/1731] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:25 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 1086 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:48:26.469143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d4f7d-a549-40b8-b71d-b46fa1465a34 service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:26.489972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-467d4f7d-a549-40b8-b71d-b46fa1465a34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:26.570855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d4f7d-a549-40b8-b71d-b46fa1465a34 service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:26.703057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 870/1732] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:26 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 420 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:26.706938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4877-0ecf-4459-8fc6-06a8b876d5d5 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:26.712666 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4877-0ecf-4459-8fc6-06a8b876d5d5 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:26.712957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4877-0ecf-4459-8fc6-06a8b876d5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:26.723083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:26.723990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:26.724267 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:26.724619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] PATH_INFO: `/v3/projects/29fdb72a76cb4a08ae761dae09338fdb` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:26.734219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=29fdb72a76cb4a08ae761dae09338fdb)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:26.736218 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:26.775981 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-588b4877-0ecf-4459-8fc6-06a8b876d5d5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:26.778284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-588b4877-0ecf-4459-8fc6-06a8b876d5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:26.812238 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 871/1733] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:26.813846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b4877-0ecf-4459-8fc6-06a8b876d5d5 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:26.827675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-588b4877-0ecf-4459-8fc6-06a8b876d5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:26.949988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29fdb72a76cb4a08ae761dae09338fdb', 'request_id': 'req-17f9a811-5298-403a-a6cf-68c2f2d033dc'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:26.962283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29fdb72a76cb4a08ae761dae09338fdb', 'request_id': 'req-17f9a811-5298-403a-a6cf-68c2f2d033dc'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:26.983946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29fdb72a76cb4a08ae761dae09338fdb', 'request_id': 'req-17f9a811-5298-403a-a6cf-68c2f2d033dc'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:27.016842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] The token cache is being invalidate because project 29fdb72a76cb4a08ae761dae09338fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:27.017587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:27.018404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:27.028564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 863/1734] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:26 2021] DELETE /identity/v3/projects/29fdb72a76cb4a08ae761dae09338fdb => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:27.029968 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:27.041949 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:27.216779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b4877-0ecf-4459-8fc6-06a8b876d5d5 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:27.238342 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9a811-5298-403a-a6cf-68c2f2d033dc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:27.250205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de1df5-f41d-4f37-906f-b42185c20a28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:27.251039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1df5-f41d-4f37-906f-b42185c20a28 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:27.251420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1df5-f41d-4f37-906f-b42185c20a28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:27.251798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de1df5-f41d-4f37-906f-b42185c20a28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:27.255391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f4de1df5-f41d-4f37-906f-b42185c20a28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:27.441220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de1df5-f41d-4f37-906f-b42185c20a28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:27.443617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de1df5-f41d-4f37-906f-b42185c20a28 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:27.478950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 864/1735] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:27.485517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500b257-76d8-4318-9e38-89a890110de1 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:27.486666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500b257-76d8-4318-9e38-89a890110de1 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:27.489466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500b257-76d8-4318-9e38-89a890110de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:27.513659 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75a7d8-760c-4caf-9af2-75af4c26f805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:27.514413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a7d8-760c-4caf-9af2-75af4c26f805 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:27.514603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a7d8-760c-4caf-9af2-75af4c26f805 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:27.514881 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a7d8-760c-4caf-9af2-75af4c26f805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:27.518576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-4e75a7d8-760c-4caf-9af2-75af4c26f805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:27.568637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-3500b257-76d8-4318-9e38-89a890110de1 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:27.589818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3500b257-76d8-4318-9e38-89a890110de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:27.646852 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 865/1736] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:27.661511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500b257-76d8-4318-9e38-89a890110de1 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:27.671473 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3500b257-76d8-4318-9e38-89a890110de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:27.741282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500b257-76d8-4318-9e38-89a890110de1 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:27.768370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:27.779176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:27.793584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:27.793584 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] PATH_INFO: `/v3/projects/eb46152996d44299aef15b7ea8582de2` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:27.796107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb46152996d44299aef15b7ea8582de2)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:27.798297 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:27.857168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75a7d8-760c-4caf-9af2-75af4c26f805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:27.867136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75a7d8-760c-4caf-9af2-75af4c26f805 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:27.909453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 872/1737] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:26 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 1096 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:27.910454 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75a7d8-760c-4caf-9af2-75af4c26f805 service nova] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:27.922765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-4e75a7d8-760c-4caf-9af2-75af4c26f805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:28.001120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75a7d8-760c-4caf-9af2-75af4c26f805 service nova] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:28.033608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb46152996d44299aef15b7ea8582de2', 'request_id': 'req-93d0c013-ca45-4482-8210-f04b8efaed75'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.059534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb46152996d44299aef15b7ea8582de2', 'request_id': 'req-93d0c013-ca45-4482-8210-f04b8efaed75'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.093454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb46152996d44299aef15b7ea8582de2', 'request_id': 'req-93d0c013-ca45-4482-8210-f04b8efaed75'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.166778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] The token cache is being invalidate because project eb46152996d44299aef15b7ea8582de2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:28.167115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.172161 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-93d0c013-ca45-4482-8210-f04b8efaed75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.193588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 866/1738] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:27 2021] DELETE /identity/v3/projects/eb46152996d44299aef15b7ea8582de2 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:28.193588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1811d6-c5a2-4318-884a-080c0d020ac0 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:28.198549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1811d6-c5a2-4318-884a-080c0d020ac0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:28.198942 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1811d6-c5a2-4318-884a-080c0d020ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:28.309055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-8d1811d6-c5a2-4318-884a-080c0d020ac0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:28.310890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-8d1811d6-c5a2-4318-884a-080c0d020ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:28.354369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:28.364754 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:28.365123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:28.365353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] PATH_INFO: `/v3/users/8d2bdd56622a49b9ac80f181d5f3ae36` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:28.372272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d2bdd56622a49b9ac80f181d5f3ae36)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:28.394845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 867/1739] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:28.396887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6f1b6-f910-4ca6-b2b2-29675bc3d651 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:28.397178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6f1b6-f910-4ca6-b2b2-29675bc3d651 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:28.397589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6f1b6-f910-4ca6-b2b2-29675bc3d651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:28.398033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:28.481003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-58b6f1b6-f910-4ca6-b2b2-29675bc3d651 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:28.483437 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-58b6f1b6-f910-4ca6-b2b2-29675bc3d651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:28.506940 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 868/1740] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:28.508708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6f1b6-f910-4ca6-b2b2-29675bc3d651 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:28.510948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-58b6f1b6-f910-4ca6-b2b2-29675bc3d651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:28.545402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6f1b6-f910-4ca6-b2b2-29675bc3d651 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:28.563726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:28.567926 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:28.572401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:28.573271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] PATH_INFO: `/v3/projects/6d6e5913d00e4fcf9fd804cf7314614b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:28.577307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d6e5913d00e4fcf9fd804cf7314614b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:28.588314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:28.588632 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d2bdd56622a49b9ac80f181d5f3ae36'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.630245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d2bdd56622a49b9ac80f181d5f3ae36'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.660942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d2bdd56622a49b9ac80f181d5f3ae36'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.679724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d2bdd56622a49b9ac80f181d5f3ae36'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.681137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d2bdd56622a49b9ac80f181d5f3ae36'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.701948 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 873/1741] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:27 2021] DELETE /identity/v3/users/8d2bdd56622a49b9ac80f181d5f3ae36 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:28.704379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:28.716887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:28.785085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d6e5913d00e4fcf9fd804cf7314614b', 'request_id': 'req-14196fc4-105f-485d-863a-9930fc794ad1'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.811085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d6e5913d00e4fcf9fd804cf7314614b', 'request_id': 'req-14196fc4-105f-485d-863a-9930fc794ad1'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.831929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d6e5913d00e4fcf9fd804cf7314614b', 'request_id': 'req-14196fc4-105f-485d-863a-9930fc794ad1'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.886983 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] The token cache is being invalidate because project 6d6e5913d00e4fcf9fd804cf7314614b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:28.887793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.892115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-14196fc4-105f-485d-863a-9930fc794ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:28.897534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 869/1742] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:28 2021] DELETE /identity/v3/projects/6d6e5913d00e4fcf9fd804cf7314614b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:28.899543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fcfbb-8c03-41e0-9757-7838d0d8ef43 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:28.900111 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fcfbb-8c03-41e0-9757-7838d0d8ef43 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:28.900745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57fcfbb-8c03-41e0-9757-7838d0d8ef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:28.953135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb445db4-0a8b-4745-8198-eea18180d042 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:29.012113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-d57fcfbb-8c03-41e0-9757-7838d0d8ef43 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:29.015548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d57fcfbb-8c03-41e0-9757-7838d0d8ef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:29.151918 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dd5fe-93ec-4cb7-b8fb-1a5dcd707b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:29.153560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dd5fe-93ec-4cb7-b8fb-1a5dcd707b5e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:29.157892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dd5fe-93ec-4cb7-b8fb-1a5dcd707b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:29.161745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dd5fe-93ec-4cb7-b8fb-1a5dcd707b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:29.163209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dd5fe-93ec-4cb7-b8fb-1a5dcd707b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:29.166270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dd5fe-93ec-4cb7-b8fb-1a5dcd707b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:29.173817 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dd5fe-93ec-4cb7-b8fb-1a5dcd707b5e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:29.181821 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 870/1743] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:29.184400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a94c6-fb89-45a4-99fd-a18c5c106678 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:29.187191 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a94c6-fb89-45a4-99fd-a18c5c106678 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:29.187446 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a94c6-fb89-45a4-99fd-a18c5c106678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:29.198827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 874/1744] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:29.200334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dd5fe-93ec-4cb7-b8fb-1a5dcd707b5e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:29.209501 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-933dd5fe-93ec-4cb7-b8fb-1a5dcd707b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:29.259164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-788a94c6-fb89-45a4-99fd-a18c5c106678 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:29.264507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dd5fe-93ec-4cb7-b8fb-1a5dcd707b5e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:29.267738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-788a94c6-fb89-45a4-99fd-a18c5c106678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:29.286932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:29.290341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:29.292370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:29.293611 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] PATH_INFO: `/v3/users/cd63559e253141e3986b79b165d78f31` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:29.297998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 871/1745] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:29.300087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd63559e253141e3986b79b165d78f31)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:29.301557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a94c6-fb89-45a4-99fd-a18c5c106678 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:29.314341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:29.375000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a94c6-fb89-45a4-99fd-a18c5c106678 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:29.402156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd9f5d-5b37-401b-a2d6-80ea309861cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:29.402675 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd9f5d-5b37-401b-a2d6-80ea309861cc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:29.402821 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd9f5d-5b37-401b-a2d6-80ea309861cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:29.403090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd9f5d-5b37-401b-a2d6-80ea309861cc admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:29.407179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd9f5d-5b37-401b-a2d6-80ea309861cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:29.407773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd9f5d-5b37-401b-a2d6-80ea309861cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:29.412194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd9f5d-5b37-401b-a2d6-80ea309861cc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:29.489529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 872/1746] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:29.492880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd9f5d-5b37-401b-a2d6-80ea309861cc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:29.500470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-29fd9f5d-5b37-401b-a2d6-80ea309861cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:29.512123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd63559e253141e3986b79b165d78f31'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:29.547787 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd9f5d-5b37-401b-a2d6-80ea309861cc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:29.551131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd63559e253141e3986b79b165d78f31'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:29.559194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b1c87-f197-45a4-b0f4-55fd39fcb0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:29.561793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1c87-f197-45a4-b0f4-55fd39fcb0cc admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:29.563455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1c87-f197-45a4-b0f4-55fd39fcb0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:29.563755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b1c87-f197-45a4-b0f4-55fd39fcb0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:29.565034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b1c87-f197-45a4-b0f4-55fd39fcb0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:29.570221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd63559e253141e3986b79b165d78f31'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:29.573964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b1c87-f197-45a4-b0f4-55fd39fcb0cc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:29.582732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd63559e253141e3986b79b165d78f31'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:29.583553 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd63559e253141e3986b79b165d78f31'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:29.592294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 875/1747] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:29 2021] DELETE /identity/v3/users/cd63559e253141e3986b79b165d78f31 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:29.594140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:29.597131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:29.710207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 873/1748] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:29 2021] POST /identity/v3/projects => generated 365 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:29.710207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9472918-72db-4ad9-99c3-6c1b5e157f35 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:29.710207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9472918-72db-4ad9-99c3-6c1b5e157f35 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:29.710207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9472918-72db-4ad9-99c3-6c1b5e157f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:29.789092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b9472918-72db-4ad9-99c3-6c1b5e157f35 None None] MFA Rules not processed for user `e9c2500682e64b3a91e811a3ba09bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:29.790648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b9472918-72db-4ad9-99c3-6c1b5e157f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:29.798843 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc48138d-f186-497c-b66a-1e714858bc5b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:29.919563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba844fa2-6198-4639-a2f2-c26f87787808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:29.920708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844fa2-6198-4639-a2f2-c26f87787808 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:29.921156 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844fa2-6198-4639-a2f2-c26f87787808 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:29.921655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba844fa2-6198-4639-a2f2-c26f87787808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:29.923966 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ba844fa2-6198-4639-a2f2-c26f87787808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:30.005871 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba844fa2-6198-4639-a2f2-c26f87787808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:30.007647 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba844fa2-6198-4639-a2f2-c26f87787808 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:30.021551 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 874/1749] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:29 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:30.021551 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9472918-72db-4ad9-99c3-6c1b5e157f35 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:30.030916 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b9472918-72db-4ad9-99c3-6c1b5e157f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:30.038385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 876/1750] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:30.042697 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba844fa2-6198-4639-a2f2-c26f87787808 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:30.046501 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ba844fa2-6198-4639-a2f2-c26f87787808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:30.074629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9472918-72db-4ad9-99c3-6c1b5e157f35 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:30.083426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9d815-662a-497d-ae2f-6de31fd5c19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:30.084937 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9d815-662a-497d-ae2f-6de31fd5c19a admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:30.085433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9d815-662a-497d-ae2f-6de31fd5c19a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:30.086411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9d815-662a-497d-ae2f-6de31fd5c19a admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:30.087760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9d815-662a-497d-ae2f-6de31fd5c19a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:30.091044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9d815-662a-497d-ae2f-6de31fd5c19a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:30.092201 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba844fa2-6198-4639-a2f2-c26f87787808 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:30.105559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ab757-3180-4f9e-ba73-41f7ba910914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:30.106372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ab757-3180-4f9e-ba73-41f7ba910914 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:30.106657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ab757-3180-4f9e-ba73-41f7ba910914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:30.106932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ab757-3180-4f9e-ba73-41f7ba910914 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:30.107805 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ab757-3180-4f9e-ba73-41f7ba910914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:30.110813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ab757-3180-4f9e-ba73-41f7ba910914 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:30.162810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 877/1751] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:30 2021] POST /identity/v3/users => generated 283 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:30.162810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ab757-3180-4f9e-ba73-41f7ba910914 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:30.167999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-209ab757-3180-4f9e-ba73-41f7ba910914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:30.190902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 875/1752] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:30 2021] POST /identity/v3/projects => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:30.193150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9d815-662a-497d-ae2f-6de31fd5c19a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:30.454070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ab757-3180-4f9e-ba73-41f7ba910914 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:30.510991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9d815-662a-497d-ae2f-6de31fd5c19a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:30.522391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e6c6-1fda-4e68-a85e-96b0626863fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:30.523246 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e6c6-1fda-4e68-a85e-96b0626863fe admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:30.523534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e6c6-1fda-4e68-a85e-96b0626863fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:30.523855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494e6c6-1fda-4e68-a85e-96b0626863fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:30.524781 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494e6c6-1fda-4e68-a85e-96b0626863fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:30.527066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494e6c6-1fda-4e68-a85e-96b0626863fe admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:30.567996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 876/1753] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:30 2021] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:30.570101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e6c6-1fda-4e68-a85e-96b0626863fe admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:30.596782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494e6c6-1fda-4e68-a85e-96b0626863fe admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:30.622763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f832e3-56ce-49b7-be93-b13360350c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:30.626815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f832e3-56ce-49b7-be93-b13360350c17 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:30.633894 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f832e3-56ce-49b7-be93-b13360350c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:30.634458 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f832e3-56ce-49b7-be93-b13360350c17 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:30.635546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f832e3-56ce-49b7-be93-b13360350c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:30.681764 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f832e3-56ce-49b7-be93-b13360350c17 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:30.800463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 877/1754] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:30 2021] POST /identity/v3/users => generated 281 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:30.807675 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89807e4-bbb5-4503-ad58-461936c543de None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:30.808259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89807e4-bbb5-4503-ad58-461936c543de None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:30.808389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89807e4-bbb5-4503-ad58-461936c543de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:30.837166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac2850-9265-4089-97ed-4a39c66db443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:30.841075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac2850-9265-4089-97ed-4a39c66db443 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:30.844095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac2850-9265-4089-97ed-4a39c66db443 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:30.844787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac2850-9265-4089-97ed-4a39c66db443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:30.862289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b89807e4-bbb5-4503-ad58-461936c543de None None] MFA Rules not processed for user `51f9a10e3d87475e92fb49686f1aa456`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:30.863735 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b89807e4-bbb5-4503-ad58-461936c543de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:30.980477 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 878/1755] 10.222.0.65 () {58 vars in 1015 bytes} [Mon Dec 13 16:48:30 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:30.988595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89807e4-bbb5-4503-ad58-461936c543de None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:31.032948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89807e4-bbb5-4503-ad58-461936c543de None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:31.052919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359e9f1-8d96-4cb3-91e8-06650c642f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:31.060077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359e9f1-8d96-4cb3-91e8-06650c642f11 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:31.060856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359e9f1-8d96-4cb3-91e8-06650c642f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:31.061357 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359e9f1-8d96-4cb3-91e8-06650c642f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:31.062387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359e9f1-8d96-4cb3-91e8-06650c642f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:31.065493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359e9f1-8d96-4cb3-91e8-06650c642f11 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:31.089207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 879/1756] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:30 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:31.091775 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359e9f1-8d96-4cb3-91e8-06650c642f11 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:31.107088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac2850-9265-4089-97ed-4a39c66db443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:31.111866 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac2850-9265-4089-97ed-4a39c66db443 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:31.112697 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359e9f1-8d96-4cb3-91e8-06650c642f11 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:31.131149 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b724aa-2cd5-45c1-9a53-61a3a837ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:31.132217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b724aa-2cd5-45c1-9a53-61a3a837ecce admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:31.132605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b724aa-2cd5-45c1-9a53-61a3a837ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:31.132984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b724aa-2cd5-45c1-9a53-61a3a837ecce admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:31.141375 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b724aa-2cd5-45c1-9a53-61a3a837ecce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:31.147922 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b724aa-2cd5-45c1-9a53-61a3a837ecce admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:31.151280 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 878/1757] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:30 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 991 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:31.156420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac2850-9265-4089-97ed-4a39c66db443 service nova] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:31.161352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-91ac2850-9265-4089-97ed-4a39c66db443 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:31.178034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 880/1758] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:31 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:31.179417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b724aa-2cd5-45c1-9a53-61a3a837ecce admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:31.196744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b724aa-2cd5-45c1-9a53-61a3a837ecce admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:31.206576 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4795-611b-4321-851f-6555514ab345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:31.207727 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4795-611b-4321-851f-6555514ab345 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:31.208213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4795-611b-4321-851f-6555514ab345 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:31.208507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4795-611b-4321-851f-6555514ab345 admin admin] PATH_INFO: `/v3/projects/727dfddb6eac450b8882f22c2dcd5262/users/be00bd300e434391ac32ceca4a32a71e/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:31.219221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac2850-9265-4089-97ed-4a39c66db443 service nova] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:31.236322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd4795-611b-4321-851f-6555514ab345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=727dfddb6eac450b8882f22c2dcd5262, user_id=be00bd300e434391ac32ceca4a32a71e, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:31.240496 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d62ed-4b3f-4341-b7b4-79f1e8edfd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:31.241842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd4795-611b-4321-851f-6555514ab345 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:31.242712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d62ed-4b3f-4341-b7b4-79f1e8edfd3d service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:31.245426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d62ed-4b3f-4341-b7b4-79f1e8edfd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:31.245890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d62ed-4b3f-4341-b7b4-79f1e8edfd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:31.276897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d62ed-4b3f-4341-b7b4-79f1e8edfd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:31.280610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453d62ed-4b3f-4341-b7b4-79f1e8edfd3d service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:31.293408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 881/1759] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:31 2021] PUT /identity/v3/projects/727dfddb6eac450b8882f22c2dcd5262/users/be00bd300e434391ac32ceca4a32a71e/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:31.301396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4795-611b-4321-851f-6555514ab345 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:31.330462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 879/1760] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:31 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:31.333506 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d62ed-4b3f-4341-b7b4-79f1e8edfd3d service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:31.337417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-453d62ed-4b3f-4341-b7b4-79f1e8edfd3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:31.414039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d62ed-4b3f-4341-b7b4-79f1e8edfd3d service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:31.824868 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:31.826087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:31.826519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:31.826903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] PATH_INFO: `/v3/projects/480c1ef598024185872b86bbe83a09a9` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:31.831079 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4795-611b-4321-851f-6555514ab345 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:31.835934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480c1ef598024185872b86bbe83a09a9)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:31.846737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:31.870156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb9fcc-68e3-4ce4-b94f-562cfde88ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:31.871934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9fcc-68e3-4ce4-b94f-562cfde88ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:31.874287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9fcc-68e3-4ce4-b94f-562cfde88ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:31.876668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9fcc-68e3-4ce4-b94f-562cfde88ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:31.884368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb9fcc-68e3-4ce4-b94f-562cfde88ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:31.899811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb9fcc-68e3-4ce4-b94f-562cfde88ae7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:31.978386 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 882/1761] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:31 2021] GET /identity/v3/roles => generated 1420 bytes in 684 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:31.981015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248a8d-0da5-44a4-8d95-a4dfaf8a658f None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:31.981220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248a8d-0da5-44a4-8d95-a4dfaf8a658f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:31.981643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb248a8d-0da5-44a4-8d95-a4dfaf8a658f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:31.999375 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480c1ef598024185872b86bbe83a09a9', 'request_id': 'req-44cf3c74-c53b-48e4-a12b-487aa5aff808'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:32.021361 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480c1ef598024185872b86bbe83a09a9', 'request_id': 'req-44cf3c74-c53b-48e4-a12b-487aa5aff808'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:32.039613 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480c1ef598024185872b86bbe83a09a9', 'request_id': 'req-44cf3c74-c53b-48e4-a12b-487aa5aff808'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:32.086676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] The token cache is being invalidate because project 480c1ef598024185872b86bbe83a09a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:32.087017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:32.094592 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:32.107724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 880/1762] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:31 2021] DELETE /identity/v3/projects/480c1ef598024185872b86bbe83a09a9 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:32.117209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:32.126323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:32.173450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-eb248a8d-0da5-44a4-8d95-a4dfaf8a658f None None] MFA Rules not processed for user `be00bd300e434391ac32ceca4a32a71e`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:32.179705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-eb248a8d-0da5-44a4-8d95-a4dfaf8a658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:32.387565 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3c74-c53b-48e4-a12b-487aa5aff808 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:32.400866 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:32.404117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:32.404386 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:32.404811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] PATH_INFO: `/v3/projects/124e2e3cc77c438696f1abea3bf1a7d8` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:32.413461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=124e2e3cc77c438696f1abea3bf1a7d8)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:32.431704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:32.576559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 883/1763] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:31 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:32.580617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb248a8d-0da5-44a4-8d95-a4dfaf8a658f None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:32.587965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-eb248a8d-0da5-44a4-8d95-a4dfaf8a658f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:32.644467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124e2e3cc77c438696f1abea3bf1a7d8', 'request_id': 'req-cdc00b85-8aaa-462a-b28a-938696a4ce0a'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:32.655331 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb248a8d-0da5-44a4-8d95-a4dfaf8a658f None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:32.696241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124e2e3cc77c438696f1abea3bf1a7d8', 'request_id': 'req-cdc00b85-8aaa-462a-b28a-938696a4ce0a'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:32.723173 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124e2e3cc77c438696f1abea3bf1a7d8', 'request_id': 'req-cdc00b85-8aaa-462a-b28a-938696a4ce0a'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:32.759696 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] The token cache is being invalidate because project 124e2e3cc77c438696f1abea3bf1a7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:32.760088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:32.760690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:32.762628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 881/1764] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:32 2021] DELETE /identity/v3/projects/124e2e3cc77c438696f1abea3bf1a7d8 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:32.772305 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:32.784484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:32.855925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9ac4-a8d2-4302-99d9-225825ab0610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:32.859736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9ac4-a8d2-4302-99d9-225825ab0610 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:32.860284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9ac4-a8d2-4302-99d9-225825ab0610 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:32.860789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd9ac4-a8d2-4302-99d9-225825ab0610 admin admin] PATH_INFO: `/v3/projects/f5b025dfc2c848d7aef6e0103fe67271/users/53a664d15d8048a8a871bfeb4bf8bc0f/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:32.929816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd9ac4-a8d2-4302-99d9-225825ab0610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b025dfc2c848d7aef6e0103fe67271, user_id=53a664d15d8048a8a871bfeb4bf8bc0f, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:32.947202 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd9ac4-a8d2-4302-99d9-225825ab0610 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:33.008998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 884/1765] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:32 2021] PUT /identity/v3/projects/f5b025dfc2c848d7aef6e0103fe67271/users/53a664d15d8048a8a871bfeb4bf8bc0f/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:33.025598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc00b85-8aaa-462a-b28a-938696a4ce0a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:33.046642 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9ac4-a8d2-4302-99d9-225825ab0610 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:33.052478 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cdbd9ac4-a8d2-4302-99d9-225825ab0610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:33.188103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09ffbe-cbc9-4696-a8fb-e4e1a0cb456a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:33.189901 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09ffbe-cbc9-4696-a8fb-e4e1a0cb456a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:33.191060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09ffbe-cbc9-4696-a8fb-e4e1a0cb456a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:33.191501 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09ffbe-cbc9-4696-a8fb-e4e1a0cb456a admin admin] PATH_INFO: `/v3/users/485559bcb2e347c6b8c1328158ea3677` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:33.193302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09ffbe-cbc9-4696-a8fb-e4e1a0cb456a admin admin] RBAC: Authorizing `identity:delete_user(user_id=485559bcb2e347c6b8c1328158ea3677)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:33.195565 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09ffbe-cbc9-4696-a8fb-e4e1a0cb456a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:33.368343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd9ac4-a8d2-4302-99d9-225825ab0610 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:33.375494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a8524-629b-473a-a226-bad39eba0b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:33.376350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a8524-629b-473a-a226-bad39eba0b08 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:33.377424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a8524-629b-473a-a226-bad39eba0b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:33.377424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a8524-629b-473a-a226-bad39eba0b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:33.379039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a8524-629b-473a-a226-bad39eba0b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:33.382668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a8524-629b-473a-a226-bad39eba0b08 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:33.383533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2f09ffbe-cbc9-4696-a8fb-e4e1a0cb456a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '485559bcb2e347c6b8c1328158ea3677'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:33.427727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2f09ffbe-cbc9-4696-a8fb-e4e1a0cb456a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '485559bcb2e347c6b8c1328158ea3677'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:33.447086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 885/1766] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:33 2021] POST /identity/v3/projects => generated 365 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:33.450290 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056597c-33b7-44a9-87bc-9e69f2d2d354 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:33.458498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2f09ffbe-cbc9-4696-a8fb-e4e1a0cb456a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '485559bcb2e347c6b8c1328158ea3677'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:33.464208 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056597c-33b7-44a9-87bc-9e69f2d2d354 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:33.465087 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056597c-33b7-44a9-87bc-9e69f2d2d354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:33.477601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2f09ffbe-cbc9-4696-a8fb-e4e1a0cb456a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '485559bcb2e347c6b8c1328158ea3677'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:33.487142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2f09ffbe-cbc9-4696-a8fb-e4e1a0cb456a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '485559bcb2e347c6b8c1328158ea3677'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:33.497466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-1056597c-33b7-44a9-87bc-9e69f2d2d354 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:33.499256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1056597c-33b7-44a9-87bc-9e69f2d2d354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:33.505852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 882/1767] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:32 2021] DELETE /identity/v3/users/485559bcb2e347c6b8c1328158ea3677 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:33.507534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ff80-e6b4-4b96-95d5-b5d1c12cf406 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:33.510576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ff80-e6b4-4b96-95d5-b5d1c12cf406 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:33.514230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4ff80-e6b4-4b96-95d5-b5d1c12cf406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:33.584224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 886/1768] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:33.585118 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056597c-33b7-44a9-87bc-9e69f2d2d354 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:33.586546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1056597c-33b7-44a9-87bc-9e69f2d2d354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:33.601466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056597c-33b7-44a9-87bc-9e69f2d2d354 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:33.608866 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02070d17-50d9-40cf-b9e3-a31b7d3aa722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:33.609896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02070d17-50d9-40cf-b9e3-a31b7d3aa722 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:33.610541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02070d17-50d9-40cf-b9e3-a31b7d3aa722 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:33.610957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02070d17-50d9-40cf-b9e3-a31b7d3aa722 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:33.612127 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02070d17-50d9-40cf-b9e3-a31b7d3aa722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:33.614672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02070d17-50d9-40cf-b9e3-a31b7d3aa722 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:33.648792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 887/1769] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:33 2021] POST /identity/v3/users => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:33.650228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-8fe4ff80-e6b4-4b96-95d5-b5d1c12cf406 None None] MFA Rules not processed for user `53a664d15d8048a8a871bfeb4bf8bc0f`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:33.652026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2778c09-4859-4db1-ab4b-cb7acf692f86 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:33.653623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2778c09-4859-4db1-ab4b-cb7acf692f86 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:33.654033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2778c09-4859-4db1-ab4b-cb7acf692f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:33.655785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8fe4ff80-e6b4-4b96-95d5-b5d1c12cf406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:33.680833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e2778c09-4859-4db1-ab4b-cb7acf692f86 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:33.682599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e2778c09-4859-4db1-ab4b-cb7acf692f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:33.695615 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 888/1770] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:33.695615 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2778c09-4859-4db1-ab4b-cb7acf692f86 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:33.718379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2778c09-4859-4db1-ab4b-cb7acf692f86 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:33.730803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b1af1-960b-43d9-b7c5-fa3f22c82db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:33.732245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b1af1-960b-43d9-b7c5-fa3f22c82db5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:33.734099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b1af1-960b-43d9-b7c5-fa3f22c82db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:33.734714 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b1af1-960b-43d9-b7c5-fa3f22c82db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:33.737398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b1af1-960b-43d9-b7c5-fa3f22c82db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:33.741565 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b1af1-960b-43d9-b7c5-fa3f22c82db5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:33.776647 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 889/1771] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:33 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:33.777639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b1af1-960b-43d9-b7c5-fa3f22c82db5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:33.796688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b1af1-960b-43d9-b7c5-fa3f22c82db5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:33.808830 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816a55c-decb-4ead-bfd2-5ef14e6f19f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:33.811044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a55c-decb-4ead-bfd2-5ef14e6f19f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:33.812897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a55c-decb-4ead-bfd2-5ef14e6f19f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:33.813322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816a55c-decb-4ead-bfd2-5ef14e6f19f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:33.815522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a55c-decb-4ead-bfd2-5ef14e6f19f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:33.817587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a55c-decb-4ead-bfd2-5ef14e6f19f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:33.823298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816a55c-decb-4ead-bfd2-5ef14e6f19f3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:33.857797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 890/1772] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:33.857797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816a55c-decb-4ead-bfd2-5ef14e6f19f3 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:33.858539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 883/1773] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:33 2021] POST /identity/v3/auth/tokens => generated 3228 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:33.861102 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ff80-e6b4-4b96-95d5-b5d1c12cf406 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:33.885054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816a55c-decb-4ead-bfd2-5ef14e6f19f3 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:33.888336 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4ff80-e6b4-4b96-95d5-b5d1c12cf406 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:33.899483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643db83e-1fa3-4487-ac8d-f7f24b327158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:33.900679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8374fa7-35ea-4588-825b-ef398ae31bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:33.901772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db83e-1fa3-4487-ac8d-f7f24b327158 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:33.902903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db83e-1fa3-4487-ac8d-f7f24b327158 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:33.903401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8374fa7-35ea-4588-825b-ef398ae31bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:33.903691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8374fa7-35ea-4588-825b-ef398ae31bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:33.903806 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643db83e-1fa3-4487-ac8d-f7f24b327158 admin admin] PATH_INFO: `/v3/projects/e7bfa6adad914b0da75e640211aa8d53/users/d4ea75ed078f42e2b649d7f369cc1d5e/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:33.903964 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8374fa7-35ea-4588-825b-ef398ae31bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:33.907323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8374fa7-35ea-4588-825b-ef398ae31bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:33.912370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8374fa7-35ea-4588-825b-ef398ae31bd9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:33.968217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643db83e-1fa3-4487-ac8d-f7f24b327158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7bfa6adad914b0da75e640211aa8d53, user_id=d4ea75ed078f42e2b649d7f369cc1d5e, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:33.982152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643db83e-1fa3-4487-ac8d-f7f24b327158 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:34.025249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 884/1774] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:33 2021] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:34.026548 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8374fa7-35ea-4588-825b-ef398ae31bd9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:34.033913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a8374fa7-35ea-4588-825b-ef398ae31bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:34.042759 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 891/1775] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:33 2021] PUT /identity/v3/projects/e7bfa6adad914b0da75e640211aa8d53/users/d4ea75ed078f42e2b649d7f369cc1d5e/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:34.048234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643db83e-1fa3-4487-ac8d-f7f24b327158 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:34.368123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643db83e-1fa3-4487-ac8d-f7f24b327158 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:34.371641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8374fa7-35ea-4588-825b-ef398ae31bd9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:34.385512 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bda2d-44f3-4037-9a6d-ff9d54efef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:34.388937 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bda2d-44f3-4037-9a6d-ff9d54efef8d admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:34.390427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bda2d-44f3-4037-9a6d-ff9d54efef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:34.391359 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bda2d-44f3-4037-9a6d-ff9d54efef8d admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:34.393187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bda2d-44f3-4037-9a6d-ff9d54efef8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:34.401717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bda2d-44f3-4037-9a6d-ff9d54efef8d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:34.417402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedb414-258c-4623-a2c0-052b119a9303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:34.418343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb414-258c-4623-a2c0-052b119a9303 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:34.418712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb414-258c-4623-a2c0-052b119a9303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:34.418993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dedb414-258c-4623-a2c0-052b119a9303 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:34.419726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedb414-258c-4623-a2c0-052b119a9303 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:34.421743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dedb414-258c-4623-a2c0-052b119a9303 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:34.470737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 892/1776] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:34 2021] POST /identity/v3/users => generated 289 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:34.472136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bda2d-44f3-4037-9a6d-ff9d54efef8d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:34.521374 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bda2d-44f3-4037-9a6d-ff9d54efef8d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:34.536103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 885/1777] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:34 2021] POST /identity/v3/projects => generated 365 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:34.537930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedb414-258c-4623-a2c0-052b119a9303 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:34.540845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41caf86-aca8-4fe4-9297-2f0b777ddb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:34.548687 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41caf86-aca8-4fe4-9297-2f0b777ddb0d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:34.549067 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41caf86-aca8-4fe4-9297-2f0b777ddb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:34.549996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41caf86-aca8-4fe4-9297-2f0b777ddb0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:34.551694 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41caf86-aca8-4fe4-9297-2f0b777ddb0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:34.556356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41caf86-aca8-4fe4-9297-2f0b777ddb0d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:34.605780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 893/1778] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:34 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:34.606808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41caf86-aca8-4fe4-9297-2f0b777ddb0d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:34.639441 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41caf86-aca8-4fe4-9297-2f0b777ddb0d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:34.683577 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dedb414-258c-4623-a2c0-052b119a9303 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:34.689103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b13b0-7503-4df5-934d-c4c12f6449e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:34.689944 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b13b0-7503-4df5-934d-c4c12f6449e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:34.690412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b13b0-7503-4df5-934d-c4c12f6449e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:34.690912 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b13b0-7503-4df5-934d-c4c12f6449e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:34.691650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b13b0-7503-4df5-934d-c4c12f6449e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:34.693770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b13b0-7503-4df5-934d-c4c12f6449e1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:34.708095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 886/1779] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:34 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:34.709388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b13b0-7503-4df5-934d-c4c12f6449e1 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:34.721482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b13b0-7503-4df5-934d-c4c12f6449e1 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:34.729323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451bfa2-a5df-4a74-8583-281faac03408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:34.730805 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451bfa2-a5df-4a74-8583-281faac03408 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:34.731291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451bfa2-a5df-4a74-8583-281faac03408 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:34.731765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451bfa2-a5df-4a74-8583-281faac03408 admin admin] PATH_INFO: `/v3/projects/e7bfa6adad914b0da75e640211aa8d53/users/d4ea75ed078f42e2b649d7f369cc1d5e/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:34.734195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451bfa2-a5df-4a74-8583-281faac03408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7bfa6adad914b0da75e640211aa8d53, user_id=d4ea75ed078f42e2b649d7f369cc1d5e, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:34.738218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451bfa2-a5df-4a74-8583-281faac03408 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:34.763847 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 887/1780] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:34 2021] PUT /identity/v3/projects/e7bfa6adad914b0da75e640211aa8d53/users/d4ea75ed078f42e2b649d7f369cc1d5e/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:34.765107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451bfa2-a5df-4a74-8583-281faac03408 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:34.853927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451bfa2-a5df-4a74-8583-281faac03408 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:34.860308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab951bf0-fb23-403a-859f-35110e3e2424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:34.861503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951bf0-fb23-403a-859f-35110e3e2424 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:34.861837 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951bf0-fb23-403a-859f-35110e3e2424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:34.862216 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951bf0-fb23-403a-859f-35110e3e2424 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:34.863248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab951bf0-fb23-403a-859f-35110e3e2424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:34.864858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07477d-c658-47fa-aad3-1266974f7bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:34.865554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab951bf0-fb23-403a-859f-35110e3e2424 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:34.867467 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07477d-c658-47fa-aad3-1266974f7bed admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:34.868024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07477d-c658-47fa-aad3-1266974f7bed admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:34.869177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07477d-c658-47fa-aad3-1266974f7bed admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:34.871288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07477d-c658-47fa-aad3-1266974f7bed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:34.875340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07477d-c658-47fa-aad3-1266974f7bed admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:34.882387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 888/1781] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:34 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:34.882387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8675ed5-a16b-4b8c-97f4-f4f008b42d0c None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:34.882387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8675ed5-a16b-4b8c-97f4-f4f008b42d0c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:34.882387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8675ed5-a16b-4b8c-97f4-f4f008b42d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:34.923111 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-a8675ed5-a16b-4b8c-97f4-f4f008b42d0c None None] MFA Rules not processed for user `d4ea75ed078f42e2b649d7f369cc1d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:34.925850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a8675ed5-a16b-4b8c-97f4-f4f008b42d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:34.953448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 894/1782] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:34 2021] POST /identity/v3/users => generated 289 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:34.958033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07477d-c658-47fa-aad3-1266974f7bed admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:35.012427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07477d-c658-47fa-aad3-1266974f7bed admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:35.027327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571bd1b-59ff-4272-a87f-62290d2f7a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:35.028225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571bd1b-59ff-4272-a87f-62290d2f7a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:35.028597 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571bd1b-59ff-4272-a87f-62290d2f7a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:35.028956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571bd1b-59ff-4272-a87f-62290d2f7a48 admin admin] PATH_INFO: `/v3/projects/351563e23f2a4ddbbf5abd4ecb8ca98d/users/6a7120050c8243099de6e207b112b5b4/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:35.078385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 889/1783] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:34 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:35.080526 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8675ed5-a16b-4b8c-97f4-f4f008b42d0c None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:35.083440 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571bd1b-59ff-4272-a87f-62290d2f7a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351563e23f2a4ddbbf5abd4ecb8ca98d, user_id=6a7120050c8243099de6e207b112b5b4, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:35.097464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571bd1b-59ff-4272-a87f-62290d2f7a48 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:35.099989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8675ed5-a16b-4b8c-97f4-f4f008b42d0c None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:35.106485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd568ed0-2dee-4605-94fe-93abdbc1e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:35.107902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568ed0-2dee-4605-94fe-93abdbc1e992 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:35.108094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568ed0-2dee-4605-94fe-93abdbc1e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:35.108752 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd568ed0-2dee-4605-94fe-93abdbc1e992 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:35.110212 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd568ed0-2dee-4605-94fe-93abdbc1e992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:35.113925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd568ed0-2dee-4605-94fe-93abdbc1e992 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:35.134238 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 890/1784] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:35 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:35.134454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 895/1785] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:34 2021] PUT /identity/v3/projects/351563e23f2a4ddbbf5abd4ecb8ca98d/users/6a7120050c8243099de6e207b112b5b4/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:35.134557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0f52-295d-422b-b937-e29ada77ca16 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:35.134557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0f52-295d-422b-b937-e29ada77ca16 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:35.134747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571bd1b-59ff-4272-a87f-62290d2f7a48 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:35.134834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b0f52-295d-422b-b937-e29ada77ca16 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:35.136509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 891/1786] 10.222.0.62 () {54 vars in 921 bytes} [Mon Dec 13 16:48:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:48:35.142056 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-8571bd1b-59ff-4272-a87f-62290d2f7a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:35.142859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15abd86-c7ea-4a8c-a9a9-ebd4e22e195a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:35.143314 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15abd86-c7ea-4a8c-a9a9-ebd4e22e195a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:35.144075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15abd86-c7ea-4a8c-a9a9-ebd4e22e195a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:35.193211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-b15abd86-c7ea-4a8c-a9a9-ebd4e22e195a None None] MFA Rules not processed for user `6a7120050c8243099de6e207b112b5b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:35.200206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b15abd86-c7ea-4a8c-a9a9-ebd4e22e195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:35.291121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571bd1b-59ff-4272-a87f-62290d2f7a48 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:35.305511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45522fdd-46b1-4dd7-b4e8-4941b504613d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:35.306520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522fdd-46b1-4dd7-b4e8-4941b504613d service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:35.306839 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522fdd-46b1-4dd7-b4e8-4941b504613d service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:35.307135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45522fdd-46b1-4dd7-b4e8-4941b504613d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:35.437398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 892/1787] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:35 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:35.438544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15abd86-c7ea-4a8c-a9a9-ebd4e22e195a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:35.515667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45522fdd-46b1-4dd7-b4e8-4941b504613d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:35.519120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45522fdd-46b1-4dd7-b4e8-4941b504613d service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:35.557261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 896/1788] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:35 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:35.561017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf16a28-f0de-4c67-8d46-0c9efda7e250 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:35.561491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf16a28-f0de-4c67-8d46-0c9efda7e250 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:35.561773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf16a28-f0de-4c67-8d46-0c9efda7e250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:35.607989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15abd86-c7ea-4a8c-a9a9-ebd4e22e195a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:35.615171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f16c0b-39f3-4c5a-81a5-53cef69c4f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:35.616398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f16c0b-39f3-4c5a-81a5-53cef69c4f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:35.616768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-fbf16a28-f0de-4c67-8d46-0c9efda7e250 None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:35.617073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f16c0b-39f3-4c5a-81a5-53cef69c4f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:35.617362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f16c0b-39f3-4c5a-81a5-53cef69c4f62 admin admin] PATH_INFO: `/v3/projects/91dc3553edda40aab377c16ef79b1dd9/users/25b89887a34e4759a060088604b040ec/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:35.619640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fbf16a28-f0de-4c67-8d46-0c9efda7e250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:35.667400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f16c0b-39f3-4c5a-81a5-53cef69c4f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91dc3553edda40aab377c16ef79b1dd9, user_id=25b89887a34e4759a060088604b040ec, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:35.686786 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f16c0b-39f3-4c5a-81a5-53cef69c4f62 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:35.763574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 893/1789] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:35 2021] PUT /identity/v3/projects/91dc3553edda40aab377c16ef79b1dd9/users/25b89887a34e4759a060088604b040ec/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:35.764425 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f16c0b-39f3-4c5a-81a5-53cef69c4f62 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:35.926966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 897/1790] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Dec 13 16:48:35 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:35.927875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf16a28-f0de-4c67-8d46-0c9efda7e250 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:35.931455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fbf16a28-f0de-4c67-8d46-0c9efda7e250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:35.985394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf16a28-f0de-4c67-8d46-0c9efda7e250 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:36.007241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:36.009498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:36.009793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:36.011782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] PATH_INFO: `/v3/projects/cfe6568947f44c95a74c06100e9070e8` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:36.012248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f16c0b-39f3-4c5a-81a5-53cef69c4f62 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:36.014457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe6568947f44c95a74c06100e9070e8)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:36.024795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:36.034650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e337236-b9f2-431e-9d02-be9726b1415b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:36.035573 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e337236-b9f2-431e-9d02-be9726b1415b admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:36.035967 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e337236-b9f2-431e-9d02-be9726b1415b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:36.037297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e337236-b9f2-431e-9d02-be9726b1415b admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:36.038041 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e337236-b9f2-431e-9d02-be9726b1415b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:36.042008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e337236-b9f2-431e-9d02-be9726b1415b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:36.124265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 894/1791] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:35 2021] POST /identity/v3/projects => generated 375 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:36.124265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e337236-b9f2-431e-9d02-be9726b1415b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:36.240144 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe6568947f44c95a74c06100e9070e8', 'request_id': 'req-30714fe2-6ab6-4382-a41d-46706123baa9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:36.269081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe6568947f44c95a74c06100e9070e8', 'request_id': 'req-30714fe2-6ab6-4382-a41d-46706123baa9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:36.334156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe6568947f44c95a74c06100e9070e8', 'request_id': 'req-30714fe2-6ab6-4382-a41d-46706123baa9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:36.376074 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e337236-b9f2-431e-9d02-be9726b1415b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:36.382030 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] The token cache is being invalidate because project cfe6568947f44c95a74c06100e9070e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:36.386602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:36.393577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:36.413325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 898/1792] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:35 2021] DELETE /identity/v3/projects/cfe6568947f44c95a74c06100e9070e8 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:36.416316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:36.438969 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:36.709140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a050e-727c-4a14-bf76-a1d49a738665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:36.712321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a050e-727c-4a14-bf76-a1d49a738665 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:36.713042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a050e-727c-4a14-bf76-a1d49a738665 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:36.715474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a050e-727c-4a14-bf76-a1d49a738665 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:36.717395 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a050e-727c-4a14-bf76-a1d49a738665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:36.725809 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30714fe2-6ab6-4382-a41d-46706123baa9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:36.727059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a050e-727c-4a14-bf76-a1d49a738665 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:36.749773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f1276-2013-4cd2-b4e3-9b3d3e24f386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:36.752205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f1276-2013-4cd2-b4e3-9b3d3e24f386 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:36.753295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f1276-2013-4cd2-b4e3-9b3d3e24f386 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:36.754705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f1276-2013-4cd2-b4e3-9b3d3e24f386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:36.762014 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b03f1276-2013-4cd2-b4e3-9b3d3e24f386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:36.768894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 895/1793] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:36 2021] GET /identity/v3/roles => generated 1420 bytes in 647 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:36.773120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a050e-727c-4a14-bf76-a1d49a738665 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:36.778544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-248a050e-727c-4a14-bf76-a1d49a738665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:36.813051 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f1276-2013-4cd2-b4e3-9b3d3e24f386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:36.815476 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03f1276-2013-4cd2-b4e3-9b3d3e24f386 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:36.827509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a050e-727c-4a14-bf76-a1d49a738665 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:36.845343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:36.846399 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:36.846719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:36.847206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] PATH_INFO: `/v3/users/be00bd300e434391ac32ceca4a32a71e` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:36.855095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be00bd300e434391ac32ceca4a32a71e)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:36.856719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 899/1794] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:36.857585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f1276-2013-4cd2-b4e3-9b3d3e24f386 service nova] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:36.858797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:36.864728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b03f1276-2013-4cd2-b4e3-9b3d3e24f386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:36.905924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03f1276-2013-4cd2-b4e3-9b3d3e24f386 service nova] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:36.922150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fbe7d-8e22-4bcf-9048-f58412c93048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:36.924849 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fbe7d-8e22-4bcf-9048-f58412c93048 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:36.928059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fbe7d-8e22-4bcf-9048-f58412c93048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:36.928810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fbe7d-8e22-4bcf-9048-f58412c93048 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:36.929521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fbe7d-8e22-4bcf-9048-f58412c93048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:36.932348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fbe7d-8e22-4bcf-9048-f58412c93048 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:36.997209 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 900/1795] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:36 2021] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:37.002238 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be00bd300e434391ac32ceca4a32a71e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:37.002797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51286f23-77d4-4fbf-9780-ab1e4f6bb38b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:37.003267 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51286f23-77d4-4fbf-9780-ab1e4f6bb38b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:37.003545 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51286f23-77d4-4fbf-9780-ab1e4f6bb38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:37.046997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be00bd300e434391ac32ceca4a32a71e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:37.056952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-51286f23-77d4-4fbf-9780-ab1e4f6bb38b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:37.058702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-51286f23-77d4-4fbf-9780-ab1e4f6bb38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:37.078513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be00bd300e434391ac32ceca4a32a71e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:37.158576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be00bd300e434391ac32ceca4a32a71e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:37.161421 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be00bd300e434391ac32ceca4a32a71e'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:37.171454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 901/1796] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:37.173063 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ec73a-875c-4d82-8d5d-e8cb7d4decbd None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:37.179976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ec73a-875c-4d82-8d5d-e8cb7d4decbd None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:37.181653 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ec73a-875c-4d82-8d5d-e8cb7d4decbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:37.184229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 896/1797] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:36 2021] DELETE /identity/v3/users/be00bd300e434391ac32ceca4a32a71e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:37.198340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:37.203403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:37.246231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-1c5ec73a-875c-4d82-8d5d-e8cb7d4decbd None None] MFA Rules not processed for user `c282fd140f5645ca89c2e64888ea1345`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:37.254833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1c5ec73a-875c-4d82-8d5d-e8cb7d4decbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:37.422088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 902/1798] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:37 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:37.423217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ec73a-875c-4d82-8d5d-e8cb7d4decbd None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:37.431129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1c5ec73a-875c-4d82-8d5d-e8cb7d4decbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:37.455698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ec73a-875c-4d82-8d5d-e8cb7d4decbd None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:37.461470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40821610-a47d-4b36-b421-445e56943489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:37.462164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40821610-a47d-4b36-b421-445e56943489 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:37.462437 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40821610-a47d-4b36-b421-445e56943489 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:37.462712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40821610-a47d-4b36-b421-445e56943489 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:37.463455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40821610-a47d-4b36-b421-445e56943489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:37.464723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86f741-2d9b-486a-b837-933e51bf6755 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:37.468046 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40821610-a47d-4b36-b421-445e56943489 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:37.478170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6faa-620c-4a8e-9320-9a827765b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:37.479480 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6faa-620c-4a8e-9320-9a827765b435 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:37.481670 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6faa-620c-4a8e-9320-9a827765b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:37.483829 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d6faa-620c-4a8e-9320-9a827765b435 admin admin] PATH_INFO: `/v3/projects/91dc3553edda40aab377c16ef79b1dd9/users/25b89887a34e4759a060088604b040ec/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:37.485393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 903/1799] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:37 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:37.487239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240a55-0a61-4024-96d3-e591fa3cd13b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:37.487629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240a55-0a61-4024-96d3-e591fa3cd13b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:37.488624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240a55-0a61-4024-96d3-e591fa3cd13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:37.497223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6faa-620c-4a8e-9320-9a827765b435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91dc3553edda40aab377c16ef79b1dd9, user_id=25b89887a34e4759a060088604b040ec, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:37.519556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d6faa-620c-4a8e-9320-9a827765b435 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:37.523082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-d0240a55-0a61-4024-96d3-e591fa3cd13b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:37.524818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d0240a55-0a61-4024-96d3-e591fa3cd13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:37.548224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 904/1800] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:37.549649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7567e3e-573e-4755-b7e3-f72a11891497 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:37.549946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7567e3e-573e-4755-b7e3-f72a11891497 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:37.550220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7567e3e-573e-4755-b7e3-f72a11891497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:37.573442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 897/1801] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:37 2021] PUT /identity/v3/projects/91dc3553edda40aab377c16ef79b1dd9/users/25b89887a34e4759a060088604b040ec/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:37.574402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6faa-620c-4a8e-9320-9a827765b435 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:37.574771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b7567e3e-573e-4755-b7e3-f72a11891497 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:37.576415 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b7567e3e-573e-4755-b7e3-f72a11891497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:37.685054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 905/1802] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:37.686810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7567e3e-573e-4755-b7e3-f72a11891497 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:37.704018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7567e3e-573e-4755-b7e3-f72a11891497 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:37.722155 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cde96-56da-4f05-b630-e500d308cb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:37.722931 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cde96-56da-4f05-b630-e500d308cb32 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:37.723284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cde96-56da-4f05-b630-e500d308cb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:37.723681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cde96-56da-4f05-b630-e500d308cb32 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:37.724688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cde96-56da-4f05-b630-e500d308cb32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:37.725108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cde96-56da-4f05-b630-e500d308cb32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:37.734929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cde96-56da-4f05-b630-e500d308cb32 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:37.753844 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d6faa-620c-4a8e-9320-9a827765b435 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:37.771688 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a23b3-16bb-4b2f-ace2-3c809b000664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:37.773651 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a23b3-16bb-4b2f-ace2-3c809b000664 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:37.777512 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 906/1803] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:37.777676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a23b3-16bb-4b2f-ace2-3c809b000664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:37.777676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a23b3-16bb-4b2f-ace2-3c809b000664 admin admin] PATH_INFO: `/v3/projects/35e676128a8c4a97a415bebb4ff4f1ca/users/86085eebcc6c46d490d7dd580e94dad3/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:37.777857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8141609-9580-4131-bec8-c08b6d9d939c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:37.778703 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8141609-9580-4131-bec8-c08b6d9d939c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:37.779084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8141609-9580-4131-bec8-c08b6d9d939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:37.797267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a23b3-16bb-4b2f-ace2-3c809b000664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e676128a8c4a97a415bebb4ff4f1ca, user_id=86085eebcc6c46d490d7dd580e94dad3, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:37.800557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a23b3-16bb-4b2f-ace2-3c809b000664 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:37.850391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 898/1804] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:37 2021] PUT /identity/v3/projects/35e676128a8c4a97a415bebb4ff4f1ca/users/86085eebcc6c46d490d7dd580e94dad3/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:37.853680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a23b3-16bb-4b2f-ace2-3c809b000664 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:37.855682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-446a23b3-16bb-4b2f-ace2-3c809b000664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:37.883308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a8141609-9580-4131-bec8-c08b6d9d939c None None] MFA Rules not processed for user `25b89887a34e4759a060088604b040ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:37.886038 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a8141609-9580-4131-bec8-c08b6d9d939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:38.003326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a23b3-16bb-4b2f-ace2-3c809b000664 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:38.011275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b66250-b0f1-43ce-9677-24f24773e15c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:38.013045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66250-b0f1-43ce-9677-24f24773e15c service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:38.013335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66250-b0f1-43ce-9677-24f24773e15c service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:38.013663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b66250-b0f1-43ce-9677-24f24773e15c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:38.074714 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 907/1805] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:37 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:38.075587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8141609-9580-4131-bec8-c08b6d9d939c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:38.282334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b66250-b0f1-43ce-9677-24f24773e15c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:38.283882 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b66250-b0f1-43ce-9677-24f24773e15c service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:38.307174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8141609-9580-4131-bec8-c08b6d9d939c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:38.312389 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 899/1806] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:38.313429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b66250-b0f1-43ce-9677-24f24773e15c service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:38.325939 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9138c-b163-4819-beb9-e3f25a254359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:38.326771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9138c-b163-4819-beb9-e3f25a254359 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:38.327054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9138c-b163-4819-beb9-e3f25a254359 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:38.335992 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9138c-b163-4819-beb9-e3f25a254359 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:38.337193 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9138c-b163-4819-beb9-e3f25a254359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:38.350036 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9138c-b163-4819-beb9-e3f25a254359 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:38.357958 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b66250-b0f1-43ce-9677-24f24773e15c service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:38.365087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b24fd-c1e6-46c2-ac4a-75356f667e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:38.365890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b24fd-c1e6-46c2-ac4a-75356f667e3d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:38.366145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b24fd-c1e6-46c2-ac4a-75356f667e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:38.366422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b24fd-c1e6-46c2-ac4a-75356f667e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:38.367184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b24fd-c1e6-46c2-ac4a-75356f667e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:38.372073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b24fd-c1e6-46c2-ac4a-75356f667e3d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:38.402794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 900/1807] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:38 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:38.404620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b24fd-c1e6-46c2-ac4a-75356f667e3d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:38.411977 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2f9b24fd-c1e6-46c2-ac4a-75356f667e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:38.450226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 908/1808] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:38 2021] POST /identity/v3/projects => generated 369 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:38.455131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9138c-b163-4819-beb9-e3f25a254359 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:38.625003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9138c-b163-4819-beb9-e3f25a254359 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:38.639318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b24fd-c1e6-46c2-ac4a-75356f667e3d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:38.645402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4f220-1e3e-4977-b6ac-58460741b761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:38.646329 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4f220-1e3e-4977-b6ac-58460741b761 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:38.646628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4f220-1e3e-4977-b6ac-58460741b761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:38.646968 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4f220-1e3e-4977-b6ac-58460741b761 admin admin] PATH_INFO: `/v3/projects/35e676128a8c4a97a415bebb4ff4f1ca/users/86085eebcc6c46d490d7dd580e94dad3/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:38.656227 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4f220-1e3e-4977-b6ac-58460741b761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35e676128a8c4a97a415bebb4ff4f1ca, user_id=86085eebcc6c46d490d7dd580e94dad3, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:38.659914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4f220-1e3e-4977-b6ac-58460741b761 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:38.710550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 909/1809] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:38 2021] PUT /identity/v3/projects/35e676128a8c4a97a415bebb4ff4f1ca/users/86085eebcc6c46d490d7dd580e94dad3/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:38.711589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4f220-1e3e-4977-b6ac-58460741b761 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:38.753310 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e80a3f-ef51-40cf-aae5-2f62dfb67c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:38.754096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80a3f-ef51-40cf-aae5-2f62dfb67c01 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:38.754466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80a3f-ef51-40cf-aae5-2f62dfb67c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:38.754793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e80a3f-ef51-40cf-aae5-2f62dfb67c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:38.860546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4f220-1e3e-4977-b6ac-58460741b761 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:38.868794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585eb06a-97e9-4c3c-ba99-f936bb9cc068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:38.869795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eb06a-97e9-4c3c-ba99-f936bb9cc068 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:38.870398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eb06a-97e9-4c3c-ba99-f936bb9cc068 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:38.870958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eb06a-97e9-4c3c-ba99-f936bb9cc068 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:38.871881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585eb06a-97e9-4c3c-ba99-f936bb9cc068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:38.874448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585eb06a-97e9-4c3c-ba99-f936bb9cc068 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:38.880563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e80a3f-ef51-40cf-aae5-2f62dfb67c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:38.882330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e80a3f-ef51-40cf-aae5-2f62dfb67c01 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:38.894098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 901/1810] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:38 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:38.907237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 910/1811] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:38 2021] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:38.911072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5fb4b-4dfd-491f-9705-117c43422d73 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:38.912092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585eb06a-97e9-4c3c-ba99-f936bb9cc068 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:38.913549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5fb4b-4dfd-491f-9705-117c43422d73 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:38.914089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5fb4b-4dfd-491f-9705-117c43422d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:38.932818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585eb06a-97e9-4c3c-ba99-f936bb9cc068 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:38.941622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38457e4f-1743-4fd9-ae70-2955bf24e9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:38.943190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38457e4f-1743-4fd9-ae70-2955bf24e9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:38.943837 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38457e4f-1743-4fd9-ae70-2955bf24e9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:38.944429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38457e4f-1743-4fd9-ae70-2955bf24e9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:38.946349 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38457e4f-1743-4fd9-ae70-2955bf24e9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:38.949426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38457e4f-1743-4fd9-ae70-2955bf24e9d1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:38.986025 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-e4c5fb4b-4dfd-491f-9705-117c43422d73 None None] MFA Rules not processed for user `86085eebcc6c46d490d7dd580e94dad3`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:38.987364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e4c5fb4b-4dfd-491f-9705-117c43422d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:39.006049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 911/1812] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:38 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:39.012445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38457e4f-1743-4fd9-ae70-2955bf24e9d1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:39.059752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38457e4f-1743-4fd9-ae70-2955bf24e9d1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:39.068116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b2f67-6c3a-4798-8e85-2c9a1f923c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:39.073639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b2f67-6c3a-4798-8e85-2c9a1f923c35 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:39.074095 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b2f67-6c3a-4798-8e85-2c9a1f923c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:39.074689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b2f67-6c3a-4798-8e85-2c9a1f923c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:39.078717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b2f67-6c3a-4798-8e85-2c9a1f923c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:39.084402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283b2f67-6c3a-4798-8e85-2c9a1f923c35 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:39.135883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 912/1813] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:39 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:39.135883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b2f67-6c3a-4798-8e85-2c9a1f923c35 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:39.188873 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 902/1814] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:38 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:39.190010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5fb4b-4dfd-491f-9705-117c43422d73 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:39.208698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5fb4b-4dfd-491f-9705-117c43422d73 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:39.218663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3553de-d950-4420-9259-02d04d5a6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:39.222386 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3553de-d950-4420-9259-02d04d5a6b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:39.222386 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3553de-d950-4420-9259-02d04d5a6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:39.223379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3553de-d950-4420-9259-02d04d5a6b42 admin admin] PATH_INFO: `/v3/projects/0c83d75e89094303ada1453a8319bb4b/users/3287082f33e041edbb0db82418516b80/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:39.280004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3553de-d950-4420-9259-02d04d5a6b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c83d75e89094303ada1453a8319bb4b, user_id=3287082f33e041edbb0db82418516b80, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:39.286753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3553de-d950-4420-9259-02d04d5a6b42 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:39.321654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 903/1815] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:39 2021] PUT /identity/v3/projects/0c83d75e89094303ada1453a8319bb4b/users/3287082f33e041edbb0db82418516b80/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:39.321654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3553de-d950-4420-9259-02d04d5a6b42 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:39.329034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-5e3553de-d950-4420-9259-02d04d5a6b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:39.342666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b2f67-6c3a-4798-8e85-2c9a1f923c35 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:39.478615 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fac5bb-afac-488c-b77f-3d1d589a514b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:39.478615 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fac5bb-afac-488c-b77f-3d1d589a514b service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:39.478927 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fac5bb-afac-488c-b77f-3d1d589a514b service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:39.479148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fac5bb-afac-488c-b77f-3d1d589a514b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:39.481297 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a3fac5bb-afac-488c-b77f-3d1d589a514b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:39.495460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3553de-d950-4420-9259-02d04d5a6b42 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:39.500240 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccfb9d-35b6-4168-8141-650554ff9f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:39.501316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfb9d-35b6-4168-8141-650554ff9f47 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:39.501813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfb9d-35b6-4168-8141-650554ff9f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:39.502289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfb9d-35b6-4168-8141-650554ff9f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:39.504472 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-79ccfb9d-35b6-4168-8141-650554ff9f47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:39.607101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccfb9d-35b6-4168-8141-650554ff9f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:39.609470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccfb9d-35b6-4168-8141-650554ff9f47 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:39.620354 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fac5bb-afac-488c-b77f-3d1d589a514b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:39.623343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 904/1816] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:39 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:39.625290 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c44f1-05bb-42dd-93d3-6c0b40bef73f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:39.625579 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c44f1-05bb-42dd-93d3-6c0b40bef73f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:39.626485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c44f1-05bb-42dd-93d3-6c0b40bef73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:39.637281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fac5bb-afac-488c-b77f-3d1d589a514b service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:39.653795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 913/1817] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:39 2021] GET /identity/v3/auth/tokens => generated 3228 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:39.687638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-433c44f1-05bb-42dd-93d3-6c0b40bef73f None None] MFA Rules not processed for user `3287082f33e041edbb0db82418516b80`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:39.691652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-433c44f1-05bb-42dd-93d3-6c0b40bef73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:39.858970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 905/1818] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:39 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:39.865294 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fac5bb-afac-488c-b77f-3d1d589a514b service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:39.971294 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fac5bb-afac-488c-b77f-3d1d589a514b service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:39.978630 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce5dde-eb76-484c-899b-49aba50be05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:39.979635 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5dde-eb76-484c-899b-49aba50be05d admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:39.980070 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5dde-eb76-484c-899b-49aba50be05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:39.980471 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce5dde-eb76-484c-899b-49aba50be05d admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:39.981422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce5dde-eb76-484c-899b-49aba50be05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:39.983995 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c413064-2686-4695-a77a-7a8e81e44bae None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:39.984498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c413064-2686-4695-a77a-7a8e81e44bae None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:39.984934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c413064-2686-4695-a77a-7a8e81e44bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:40.001831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce5dde-eb76-484c-899b-49aba50be05d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:40.018555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-6c413064-2686-4695-a77a-7a8e81e44bae None None] MFA Rules not processed for user `e9c2500682e64b3a91e811a3ba09bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:40.019786 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6c413064-2686-4695-a77a-7a8e81e44bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:40.051109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 914/1819] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:39 2021] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:48:40.052269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce5dde-eb76-484c-899b-49aba50be05d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:40.062417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-91ce5dde-eb76-484c-899b-49aba50be05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:40.180609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 906/1820] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:39 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:40.180609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c413064-2686-4695-a77a-7a8e81e44bae None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:40.248310 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c413064-2686-4695-a77a-7a8e81e44bae None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:40.304015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce5dde-eb76-484c-899b-49aba50be05d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:40.324065 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:40.325054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:40.325515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:40.326402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] PATH_INFO: `/v3/projects/727dfddb6eac450b8882f22c2dcd5262` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:40.328343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727dfddb6eac450b8882f22c2dcd5262)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:40.336680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:40.355500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316f766-5c50-4bd2-b709-355272fadd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:40.356259 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316f766-5c50-4bd2-b709-355272fadd13 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:40.356937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316f766-5c50-4bd2-b709-355272fadd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:40.357054 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c316f766-5c50-4bd2-b709-355272fadd13 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:40.358070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316f766-5c50-4bd2-b709-355272fadd13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:40.361644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c316f766-5c50-4bd2-b709-355272fadd13 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:40.417809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 907/1821] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:40 2021] POST /identity/v3/users => generated 291 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:40.419465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316f766-5c50-4bd2-b709-355272fadd13 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:40.436563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c316f766-5c50-4bd2-b709-355272fadd13 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:40.459488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727dfddb6eac450b8882f22c2dcd5262', 'request_id': 'req-5ce44264-1255-4030-bd60-7dbad12c5168'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:40.478227 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727dfddb6eac450b8882f22c2dcd5262', 'request_id': 'req-5ce44264-1255-4030-bd60-7dbad12c5168'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:40.509217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727dfddb6eac450b8882f22c2dcd5262', 'request_id': 'req-5ce44264-1255-4030-bd60-7dbad12c5168'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:40.525956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0fb70-e303-4e75-a165-e2fa39d6707b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:40.526760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0fb70-e303-4e75-a165-e2fa39d6707b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:40.527192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0fb70-e303-4e75-a165-e2fa39d6707b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:40.528665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff0fb70-e303-4e75-a165-e2fa39d6707b admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:40.529628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0fb70-e303-4e75-a165-e2fa39d6707b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:40.532027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff0fb70-e303-4e75-a165-e2fa39d6707b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:40.534310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] The token cache is being invalidate because project 727dfddb6eac450b8882f22c2dcd5262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:40.534605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:40.536424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:40.543228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 915/1822] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:40 2021] DELETE /identity/v3/projects/727dfddb6eac450b8882f22c2dcd5262 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:40.544239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:40.548989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:40.553184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 908/1823] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:40 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:40.554762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0fb70-e303-4e75-a165-e2fa39d6707b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:40.556551 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-4ff0fb70-e303-4e75-a165-e2fa39d6707b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:40.579364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce44264-1255-4030-bd60-7dbad12c5168 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:40.593677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c118a7-738c-4e15-bc54-74b07af303da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:40.595114 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c118a7-738c-4e15-bc54-74b07af303da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:40.595407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c118a7-738c-4e15-bc54-74b07af303da admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:40.595697 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c118a7-738c-4e15-bc54-74b07af303da admin admin] PATH_INFO: `/v3/users/d4ea75ed078f42e2b649d7f369cc1d5e` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:40.597112 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c118a7-738c-4e15-bc54-74b07af303da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ea75ed078f42e2b649d7f369cc1d5e)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:40.600441 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c118a7-738c-4e15-bc54-74b07af303da admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:40.602397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff0fb70-e303-4e75-a165-e2fa39d6707b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:40.615463 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c7031-68f0-4844-9a2f-60670cf82b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:40.617453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c7031-68f0-4844-9a2f-60670cf82b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:40.619228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c7031-68f0-4844-9a2f-60670cf82b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:40.620022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c7031-68f0-4844-9a2f-60670cf82b64 admin admin] PATH_INFO: `/v3/projects/29b64648e8004d31b0f6c462b5938649/users/fffa7569fdec44b6858a7a062fff7bd3/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:40.668058 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c7031-68f0-4844-9a2f-60670cf82b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b64648e8004d31b0f6c462b5938649, user_id=fffa7569fdec44b6858a7a062fff7bd3, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:40.670824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c7031-68f0-4844-9a2f-60670cf82b64 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:40.696130 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d0c118a7-738c-4e15-bc54-74b07af303da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ea75ed078f42e2b649d7f369cc1d5e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:40.706079 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 909/1824] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:40 2021] PUT /identity/v3/projects/29b64648e8004d31b0f6c462b5938649/users/fffa7569fdec44b6858a7a062fff7bd3/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:40.713185 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c7031-68f0-4844-9a2f-60670cf82b64 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:40.717559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d0c118a7-738c-4e15-bc54-74b07af303da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ea75ed078f42e2b649d7f369cc1d5e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:40.718437 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d0c118a7-738c-4e15-bc54-74b07af303da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ea75ed078f42e2b649d7f369cc1d5e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:40.727870 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d0c118a7-738c-4e15-bc54-74b07af303da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ea75ed078f42e2b649d7f369cc1d5e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:40.742177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d0c118a7-738c-4e15-bc54-74b07af303da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ea75ed078f42e2b649d7f369cc1d5e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:40.756903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 916/1825] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:40 2021] DELETE /identity/v3/users/d4ea75ed078f42e2b649d7f369cc1d5e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:40.824269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c7031-68f0-4844-9a2f-60670cf82b64 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:40.931819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447fc7b-86ea-4c57-ae84-975210a3dba5 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:40.932465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447fc7b-86ea-4c57-ae84-975210a3dba5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:40.933130 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447fc7b-86ea-4c57-ae84-975210a3dba5 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:40.934599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059132d4-b074-4bce-b02d-4355eb34d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:40.935483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059132d4-b074-4bce-b02d-4355eb34d07a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:40.935943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059132d4-b074-4bce-b02d-4355eb34d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:40.936314 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059132d4-b074-4bce-b02d-4355eb34d07a admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:40.937019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 917/1826] 10.222.0.62 () {54 vars in 912 bytes} [Mon Dec 13 16:48:40 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:48:40.938596 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059132d4-b074-4bce-b02d-4355eb34d07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:40.942282 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059132d4-b074-4bce-b02d-4355eb34d07a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:40.945792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414f884-961a-4ae1-be6a-3ca343978e77 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:40.946505 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414f884-961a-4ae1-be6a-3ca343978e77 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:40.946982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414f884-961a-4ae1-be6a-3ca343978e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:40.960841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 910/1827] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:40 2021] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:40.962818 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059132d4-b074-4bce-b02d-4355eb34d07a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:40.966942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-059132d4-b074-4bce-b02d-4355eb34d07a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:40.970324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7414f884-961a-4ae1-be6a-3ca343978e77 None None] MFA Rules not processed for user `51f9a10e3d87475e92fb49686f1aa456`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:40.974068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7414f884-961a-4ae1-be6a-3ca343978e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:41.010164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059132d4-b074-4bce-b02d-4355eb34d07a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:41.022973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805ea9-1907-4a3f-ac6b-aa5cc9c2511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:41.025504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805ea9-1907-4a3f-ac6b-aa5cc9c2511c admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:41.026070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805ea9-1907-4a3f-ac6b-aa5cc9c2511c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:41.026070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805ea9-1907-4a3f-ac6b-aa5cc9c2511c admin admin] PATH_INFO: `/v3/projects/29b64648e8004d31b0f6c462b5938649/users/fffa7569fdec44b6858a7a062fff7bd3/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:41.034003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b805ea9-1907-4a3f-ac6b-aa5cc9c2511c admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b64648e8004d31b0f6c462b5938649, user_id=fffa7569fdec44b6858a7a062fff7bd3, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:41.037114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b805ea9-1907-4a3f-ac6b-aa5cc9c2511c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:41.039089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 918/1828] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:48:40 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:48:41.057248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 911/1829] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:40 2021] PUT /identity/v3/projects/29b64648e8004d31b0f6c462b5938649/users/fffa7569fdec44b6858a7a062fff7bd3/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:41.079334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47761f3b-5005-4843-8115-62aad8f0df66 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:41.079334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47761f3b-5005-4843-8115-62aad8f0df66 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:41.079334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47761f3b-5005-4843-8115-62aad8f0df66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:41.093439 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805ea9-1907-4a3f-ac6b-aa5cc9c2511c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:41.099704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-5b805ea9-1907-4a3f-ac6b-aa5cc9c2511c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:41.137854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-47761f3b-5005-4843-8115-62aad8f0df66 None None] MFA Rules not processed for user `fffa7569fdec44b6858a7a062fff7bd3`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:41.139213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-47761f3b-5005-4843-8115-62aad8f0df66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:41.254700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805ea9-1907-4a3f-ac6b-aa5cc9c2511c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:41.259407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39060dab-e7ef-4ed6-8ae0-0bea2e749c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:41.260955 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39060dab-e7ef-4ed6-8ae0-0bea2e749c7b service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:41.262988 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39060dab-e7ef-4ed6-8ae0-0bea2e749c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:41.263703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39060dab-e7ef-4ed6-8ae0-0bea2e749c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:41.277881 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39060dab-e7ef-4ed6-8ae0-0bea2e749c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:41.279860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39060dab-e7ef-4ed6-8ae0-0bea2e749c7b service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:41.292625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 912/1830] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:41.297533 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 919/1831] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:41 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:48:41.299855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39060dab-e7ef-4ed6-8ae0-0bea2e749c7b service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:41.303609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-39060dab-e7ef-4ed6-8ae0-0bea2e749c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:41.377543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47761f3b-5005-4843-8115-62aad8f0df66 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:41.380552 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-47761f3b-5005-4843-8115-62aad8f0df66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:41.414393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39060dab-e7ef-4ed6-8ae0-0bea2e749c7b service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:41.427004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:41.428001 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:41.429485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:41.429840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] PATH_INFO: `/v3/projects/e7bfa6adad914b0da75e640211aa8d53` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:41.433504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7bfa6adad914b0da75e640211aa8d53)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:41.436530 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:41.501956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47761f3b-5005-4843-8115-62aad8f0df66 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:41.512344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cbc1d-9f20-4777-921b-f6d3a954ca6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:41.515078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cbc1d-9f20-4777-921b-f6d3a954ca6f service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:41.519218 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cbc1d-9f20-4777-921b-f6d3a954ca6f service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:41.519851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cbc1d-9f20-4777-921b-f6d3a954ca6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:41.548103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3cbc1d-9f20-4777-921b-f6d3a954ca6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:41.555157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3cbc1d-9f20-4777-921b-f6d3a954ca6f service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:41.587777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 920/1832] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:41 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:48:41.601053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7bfa6adad914b0da75e640211aa8d53', 'request_id': 'req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:41.623631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7bfa6adad914b0da75e640211aa8d53', 'request_id': 'req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:41.645011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7bfa6adad914b0da75e640211aa8d53', 'request_id': 'req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:41.669808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] The token cache is being invalidate because project e7bfa6adad914b0da75e640211aa8d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:41.671264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:41.672480 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:41.675840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 913/1833] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:41 2021] DELETE /identity/v3/projects/e7bfa6adad914b0da75e640211aa8d53 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:41.682660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36cf9c-aad9-4c28-958c-e25bc9b0ddda None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:41.682779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36cf9c-aad9-4c28-958c-e25bc9b0ddda None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:41.683097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36cf9c-aad9-4c28-958c-e25bc9b0ddda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:41.708180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-3a36cf9c-aad9-4c28-958c-e25bc9b0ddda None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:41.710217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3a36cf9c-aad9-4c28-958c-e25bc9b0ddda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:41.807932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:41.809809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:41.851247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 921/1834] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:41.851371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3788c-45c7-4152-94dc-f0cb8529756b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:41.851642 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3788c-45c7-4152-94dc-f0cb8529756b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:41.852054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3788c-45c7-4152-94dc-f0cb8529756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:41.895850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b5f3788c-45c7-4152-94dc-f0cb8529756b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:41.902530 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b5f3788c-45c7-4152-94dc-f0cb8529756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:41.921321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 922/1835] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:41.924084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3788c-45c7-4152-94dc-f0cb8529756b None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:41.937468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3788c-45c7-4152-94dc-f0cb8529756b None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:41.939996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a611fd3-3e65-4dfa-8ae1-4b85d86ca694 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:41.945211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962bd47-289c-4676-b27c-bb3f1df3483b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:41.946247 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962bd47-289c-4676-b27c-bb3f1df3483b service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:41.946493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c4603-e761-40c2-b5e6-6255004eaac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:41.947017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962bd47-289c-4676-b27c-bb3f1df3483b service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:41.947508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962bd47-289c-4676-b27c-bb3f1df3483b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:41.947969 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c4603-e761-40c2-b5e6-6255004eaac0 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:41.948350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c4603-e761-40c2-b5e6-6255004eaac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:41.948876 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c4603-e761-40c2-b5e6-6255004eaac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:41.949930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c4603-e761-40c2-b5e6-6255004eaac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:41.950535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c4603-e761-40c2-b5e6-6255004eaac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:41.951167 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1962bd47-289c-4676-b27c-bb3f1df3483b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:41.952754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c4603-e761-40c2-b5e6-6255004eaac0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:41.968761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 923/1836] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:41.974055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c4603-e761-40c2-b5e6-6255004eaac0 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:41.984595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c4603-e761-40c2-b5e6-6255004eaac0 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:42.001596 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e58dfe-7bc5-45ec-a7e9-4c96f139b443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:42.002770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58dfe-7bc5-45ec-a7e9-4c96f139b443 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:42.002901 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58dfe-7bc5-45ec-a7e9-4c96f139b443 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:42.003331 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e58dfe-7bc5-45ec-a7e9-4c96f139b443 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:42.004131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e58dfe-7bc5-45ec-a7e9-4c96f139b443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:42.011374 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e58dfe-7bc5-45ec-a7e9-4c96f139b443 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:42.057241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 924/1837] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:41 2021] POST /identity/v3/projects => generated 401 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:48:42.063589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e58dfe-7bc5-45ec-a7e9-4c96f139b443 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:42.113887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962bd47-289c-4676-b27c-bb3f1df3483b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:42.117036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1962bd47-289c-4676-b27c-bb3f1df3483b service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:42.130770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 914/1838] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:41 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:42.152629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e58dfe-7bc5-45ec-a7e9-4c96f139b443 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:42.157640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869985a-258f-4670-bf3b-cf165c52fd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:42.158327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869985a-258f-4670-bf3b-cf165c52fd51 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:42.158630 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869985a-258f-4670-bf3b-cf165c52fd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:42.159000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869985a-258f-4670-bf3b-cf165c52fd51 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:42.159843 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869985a-258f-4670-bf3b-cf165c52fd51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:42.162629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869985a-258f-4670-bf3b-cf165c52fd51 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:42.189607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 925/1839] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:42 2021] POST /identity/v3/users => generated 301 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:42.190759 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962bd47-289c-4676-b27c-bb3f1df3483b service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:42.207159 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962bd47-289c-4676-b27c-bb3f1df3483b service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:42.222380 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c570daf-33dd-436c-ac24-2b47304424d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:42.223211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c570daf-33dd-436c-ac24-2b47304424d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:42.223793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c570daf-33dd-436c-ac24-2b47304424d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:42.223793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c570daf-33dd-436c-ac24-2b47304424d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:42.224653 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c570daf-33dd-436c-ac24-2b47304424d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:42.226337 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c570daf-33dd-436c-ac24-2b47304424d3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:42.244784 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 915/1840] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:42 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:42.249929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869985a-258f-4670-bf3b-cf165c52fd51 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:42.262875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869985a-258f-4670-bf3b-cf165c52fd51 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:42.268651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc9bcd-7506-4321-9747-d259f5a87ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:42.269340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc9bcd-7506-4321-9747-d259f5a87ebb admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:42.269626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc9bcd-7506-4321-9747-d259f5a87ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:42.269902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc9bcd-7506-4321-9747-d259f5a87ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:42.270749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc9bcd-7506-4321-9747-d259f5a87ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:42.273001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc9bcd-7506-4321-9747-d259f5a87ebb admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:42.306851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 926/1841] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:42 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:42.311656 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c570daf-33dd-436c-ac24-2b47304424d3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:42.339669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c570daf-33dd-436c-ac24-2b47304424d3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:42.347996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c04eb-78fd-4c97-bb9b-8be68c88c663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:42.350068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c04eb-78fd-4c97-bb9b-8be68c88c663 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:42.350430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c04eb-78fd-4c97-bb9b-8be68c88c663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:42.350883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c04eb-78fd-4c97-bb9b-8be68c88c663 admin admin] PATH_INFO: `/v3/projects/975bf46bffe744c3a416d6bab235f031/users/df976cadcca245659415d89f5568e79c/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:42.383500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c04eb-78fd-4c97-bb9b-8be68c88c663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=975bf46bffe744c3a416d6bab235f031, user_id=df976cadcca245659415d89f5568e79c, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:42.394322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c04eb-78fd-4c97-bb9b-8be68c88c663 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:42.420420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 916/1842] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:42 2021] PUT /identity/v3/projects/975bf46bffe744c3a416d6bab235f031/users/df976cadcca245659415d89f5568e79c/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:42.431144 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545594f-80e6-4db9-9b3b-7ae56c61d311 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:42.431670 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545594f-80e6-4db9-9b3b-7ae56c61d311 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:42.431791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545594f-80e6-4db9-9b3b-7ae56c61d311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:42.469849 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9545594f-80e6-4db9-9b3b-7ae56c61d311 None None] MFA Rules not processed for user `df976cadcca245659415d89f5568e79c`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:42.471639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9545594f-80e6-4db9-9b3b-7ae56c61d311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:42.607664 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 927/1843] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:42 2021] POST /identity/v3/auth/tokens => generated 3268 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:42.613863 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c04eb-78fd-4c97-bb9b-8be68c88c663 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:42.707708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c04eb-78fd-4c97-bb9b-8be68c88c663 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:42.714559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc09cf8-5db4-4a1d-8f19-a58b85057b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:42.715567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc09cf8-5db4-4a1d-8f19-a58b85057b4f admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:42.716064 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc09cf8-5db4-4a1d-8f19-a58b85057b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:42.716320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc09cf8-5db4-4a1d-8f19-a58b85057b4f admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:42.717178 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc09cf8-5db4-4a1d-8f19-a58b85057b4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:42.719141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc09cf8-5db4-4a1d-8f19-a58b85057b4f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:42.746336 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 917/1844] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:42 2021] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:42.750930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545594f-80e6-4db9-9b3b-7ae56c61d311 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:42.762485 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545594f-80e6-4db9-9b3b-7ae56c61d311 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:42.830377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9080f5-663d-465f-9384-8b57583c2e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:42.831451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9080f5-663d-465f-9384-8b57583c2e87 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:42.831451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9080f5-663d-465f-9384-8b57583c2e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:42.831828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9080f5-663d-465f-9384-8b57583c2e87 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:42.832541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9080f5-663d-465f-9384-8b57583c2e87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:42.834528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9080f5-663d-465f-9384-8b57583c2e87 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:42.856977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 928/1845] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:42 2021] POST /identity/v3/users => generated 306 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:42.861312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc09cf8-5db4-4a1d-8f19-a58b85057b4f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:42.872780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc09cf8-5db4-4a1d-8f19-a58b85057b4f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:42.878671 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e3093-96d1-4746-b13c-4ce81c99d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:42.879347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3093-96d1-4746-b13c-4ce81c99d146 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:42.879627 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3093-96d1-4746-b13c-4ce81c99d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:42.879892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e3093-96d1-4746-b13c-4ce81c99d146 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:42.880678 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e3093-96d1-4746-b13c-4ce81c99d146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:42.882269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e3093-96d1-4746-b13c-4ce81c99d146 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:42.895178 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 918/1846] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:42 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:42.899601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9080f5-663d-465f-9384-8b57583c2e87 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:42.911078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9080f5-663d-465f-9384-8b57583c2e87 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:42.916861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d20a-b814-4d32-8bf6-290c580b45cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:42.917805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d20a-b814-4d32-8bf6-290c580b45cc admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:42.918089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d20a-b814-4d32-8bf6-290c580b45cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:42.918363 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547d20a-b814-4d32-8bf6-290c580b45cc admin admin] PATH_INFO: `/v3/projects/cbd0a01efc904478b82d7f1f30b88437/users/46f5f15aace44fc2a6d222b33ee9f6a2/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:42.934532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d20a-b814-4d32-8bf6-290c580b45cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd0a01efc904478b82d7f1f30b88437, user_id=46f5f15aace44fc2a6d222b33ee9f6a2, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:42.937260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5547d20a-b814-4d32-8bf6-290c580b45cc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:42.953133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 929/1847] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:42 2021] PUT /identity/v3/projects/cbd0a01efc904478b82d7f1f30b88437/users/46f5f15aace44fc2a6d222b33ee9f6a2/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:42.958087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e3093-96d1-4746-b13c-4ce81c99d146 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:42.968018 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e3093-96d1-4746-b13c-4ce81c99d146 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:43.046291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb58622-f68d-4010-b4da-4ec52e5d65c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:43.046934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb58622-f68d-4010-b4da-4ec52e5d65c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:43.047330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb58622-f68d-4010-b4da-4ec52e5d65c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:43.048074 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb58622-f68d-4010-b4da-4ec52e5d65c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:43.048717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb58622-f68d-4010-b4da-4ec52e5d65c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:43.054468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb58622-f68d-4010-b4da-4ec52e5d65c6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:43.067212 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 919/1848] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:42 2021] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:43.071179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d20a-b814-4d32-8bf6-290c580b45cc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:43.083642 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547d20a-b814-4d32-8bf6-290c580b45cc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:43.088970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9d212-4bb2-4841-8f86-c35b2222c560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:43.089885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9d212-4bb2-4841-8f86-c35b2222c560 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:43.090177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9d212-4bb2-4841-8f86-c35b2222c560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:43.090466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9d212-4bb2-4841-8f86-c35b2222c560 admin admin] PATH_INFO: `/v3/projects/cbd0a01efc904478b82d7f1f30b88437/users/46f5f15aace44fc2a6d222b33ee9f6a2/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:43.092674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9d212-4bb2-4841-8f86-c35b2222c560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd0a01efc904478b82d7f1f30b88437, user_id=46f5f15aace44fc2a6d222b33ee9f6a2, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:43.095502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9d212-4bb2-4841-8f86-c35b2222c560 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:43.109101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 930/1849] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:43 2021] PUT /identity/v3/projects/cbd0a01efc904478b82d7f1f30b88437/users/46f5f15aace44fc2a6d222b33ee9f6a2/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:43.129401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d9c0f-18dc-4aa5-9b9b-554dd838239a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:43.129401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d9c0f-18dc-4aa5-9b9b-554dd838239a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:43.129401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d9c0f-18dc-4aa5-9b9b-554dd838239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:43.161756 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-ce5d9c0f-18dc-4aa5-9b9b-554dd838239a None None] MFA Rules not processed for user `46f5f15aace44fc2a6d222b33ee9f6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:43.164273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ce5d9c0f-18dc-4aa5-9b9b-554dd838239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:43.264424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 920/1850] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:43 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:43.275867 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9d212-4bb2-4841-8f86-c35b2222c560 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:43.358902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9d212-4bb2-4841-8f86-c35b2222c560 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:43.363720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08683f-5225-469f-a202-cc6b2971dee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:43.364389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08683f-5225-469f-a202-cc6b2971dee4 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:43.364710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08683f-5225-469f-a202-cc6b2971dee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:43.364988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08683f-5225-469f-a202-cc6b2971dee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:43.375292 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08683f-5225-469f-a202-cc6b2971dee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:43.376776 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08683f-5225-469f-a202-cc6b2971dee4 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:43.388154 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 931/1851] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:43 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:43.499007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d9c0f-18dc-4aa5-9b9b-554dd838239a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:43.508678 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d9c0f-18dc-4aa5-9b9b-554dd838239a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:43.513795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1048ea5-b98e-4fa1-8623-83d40d066b9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:43.514302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048ea5-b98e-4fa1-8623-83d40d066b9a service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:43.514586 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048ea5-b98e-4fa1-8623-83d40d066b9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:43.515054 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1048ea5-b98e-4fa1-8623-83d40d066b9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:43.578126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1048ea5-b98e-4fa1-8623-83d40d066b9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:43.580698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1048ea5-b98e-4fa1-8623-83d40d066b9a service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:43.590073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 921/1852] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:43 2021] GET /identity/v3/auth/tokens => generated 3268 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:45.158684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08683f-5225-469f-a202-cc6b2971dee4 service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:45.161357 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0d08683f-5225-469f-a202-cc6b2971dee4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:45.175489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08683f-5225-469f-a202-cc6b2971dee4 service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:45.186059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c0fa4-548e-4666-a62e-3b7b494c0ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:45.186848 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c0fa4-548e-4666-a62e-3b7b494c0ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:45.187311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c0fa4-548e-4666-a62e-3b7b494c0ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:45.189010 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c0fa4-548e-4666-a62e-3b7b494c0ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:45.193023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-924c0fa4-548e-4666-a62e-3b7b494c0ee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:45.323364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c0fa4-548e-4666-a62e-3b7b494c0ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:45.325929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c0fa4-548e-4666-a62e-3b7b494c0ee2 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:45.379737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 932/1853] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:45 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:46.001091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1048ea5-b98e-4fa1-8623-83d40d066b9a service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:46.004403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d1048ea5-b98e-4fa1-8623-83d40d066b9a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:46.093609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1048ea5-b98e-4fa1-8623-83d40d066b9a service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:46.098790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:46.099679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:46.100819 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:46.101288 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] PATH_INFO: `/v3/users/3287082f33e041edbb0db82418516b80` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:46.102551 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3287082f33e041edbb0db82418516b80)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:46.104500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:46.168127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3287082f33e041edbb0db82418516b80'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:46.187043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3287082f33e041edbb0db82418516b80'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:46.205228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3287082f33e041edbb0db82418516b80'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:46.217226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3287082f33e041edbb0db82418516b80'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:46.218988 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3287082f33e041edbb0db82418516b80'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:46.226573 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 922/1854] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:46 2021] DELETE /identity/v3/users/3287082f33e041edbb0db82418516b80 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:46.233777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f190a33-092a-44c0-9ff5-2ed5c1bb6710 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:46.234846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f190a33-092a-44c0-9ff5-2ed5c1bb6710 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:46.235175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f190a33-092a-44c0-9ff5-2ed5c1bb6710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:46.413931 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-4f190a33-092a-44c0-9ff5-2ed5c1bb6710 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:46.415246 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4f190a33-092a-44c0-9ff5-2ed5c1bb6710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:46.492755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 933/1855] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:48:46.505582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:46.510155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:46.601838 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739ce44-78bc-4e94-a35e-92064b3b422d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:46.607494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b06c0-4c10-4caf-a4e1-fe079b9c2756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:46.608637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b06c0-4c10-4caf-a4e1-fe079b9c2756 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:46.609084 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b06c0-4c10-4caf-a4e1-fe079b9c2756 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:46.609515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b06c0-4c10-4caf-a4e1-fe079b9c2756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:46.625144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b06c0-4c10-4caf-a4e1-fe079b9c2756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:46.627623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b06c0-4c10-4caf-a4e1-fe079b9c2756 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:46.644108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 923/1856] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:46.923922 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f190a33-092a-44c0-9ff5-2ed5c1bb6710 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:46.926604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4f190a33-092a-44c0-9ff5-2ed5c1bb6710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:46.939397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f190a33-092a-44c0-9ff5-2ed5c1bb6710 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:46.945218 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:46.946137 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:46.946411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:46.946677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] PATH_INFO: `/v3/projects/0c83d75e89094303ada1453a8319bb4b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:46.949102 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c83d75e89094303ada1453a8319bb4b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:46.951634 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:47.002616 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c83d75e89094303ada1453a8319bb4b', 'request_id': 'req-e3879068-492e-48b8-8700-df0d8ba871fd'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.011573 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c83d75e89094303ada1453a8319bb4b', 'request_id': 'req-e3879068-492e-48b8-8700-df0d8ba871fd'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.020094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c83d75e89094303ada1453a8319bb4b', 'request_id': 'req-e3879068-492e-48b8-8700-df0d8ba871fd'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.039152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] The token cache is being invalidate because project 0c83d75e89094303ada1453a8319bb4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:47.039442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.040127 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.041768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 934/1857] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:46 2021] DELETE /identity/v3/projects/0c83d75e89094303ada1453a8319bb4b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:47.045930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b06c0-4c10-4caf-a4e1-fe079b9c2756 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:47.056033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b06c0-4c10-4caf-a4e1-fe079b9c2756 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:47.244947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db5f87-f0fe-458b-9ec6-bed9251a7fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:47.245815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5f87-f0fe-458b-9ec6-bed9251a7fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:47.246092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5f87-f0fe-458b-9ec6-bed9251a7fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:47.246360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db5f87-f0fe-458b-9ec6-bed9251a7fb4 admin admin] PATH_INFO: `/v3/users/fffa7569fdec44b6858a7a062fff7bd3` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:47.247942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db5f87-f0fe-458b-9ec6-bed9251a7fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fffa7569fdec44b6858a7a062fff7bd3)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:47.249877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db5f87-f0fe-458b-9ec6-bed9251a7fb4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:47.304110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-70db5f87-f0fe-458b-9ec6-bed9251a7fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fffa7569fdec44b6858a7a062fff7bd3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.317934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-70db5f87-f0fe-458b-9ec6-bed9251a7fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fffa7569fdec44b6858a7a062fff7bd3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.331523 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-70db5f87-f0fe-458b-9ec6-bed9251a7fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fffa7569fdec44b6858a7a062fff7bd3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.346020 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-70db5f87-f0fe-458b-9ec6-bed9251a7fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fffa7569fdec44b6858a7a062fff7bd3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.347577 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-70db5f87-f0fe-458b-9ec6-bed9251a7fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fffa7569fdec44b6858a7a062fff7bd3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.356027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 924/1858] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:47 2021] DELETE /identity/v3/users/fffa7569fdec44b6858a7a062fff7bd3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:47.762139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:47.765664 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:47.784324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3879068-492e-48b8-8700-df0d8ba871fd admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:47.857784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:47.858656 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:47.858931 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:47.859198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] PATH_INFO: `/v3/projects/29b64648e8004d31b0f6c462b5938649` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:47.860374 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b64648e8004d31b0f6c462b5938649)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:47.862595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:47.909407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b64648e8004d31b0f6c462b5938649', 'request_id': 'req-f772e17a-8f84-42a5-b910-796719316412'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.918638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b64648e8004d31b0f6c462b5938649', 'request_id': 'req-f772e17a-8f84-42a5-b910-796719316412'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.925712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b64648e8004d31b0f6c462b5938649', 'request_id': 'req-f772e17a-8f84-42a5-b910-796719316412'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.936708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] The token cache is being invalidate because project 29b64648e8004d31b0f6c462b5938649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:47.936993 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.937653 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f772e17a-8f84-42a5-b910-796719316412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:47.939257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 935/1859] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:47 2021] DELETE /identity/v3/projects/29b64648e8004d31b0f6c462b5938649 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:48:47.945523 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c1c9-3767-4223-a216-bd136361c99d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:47.945812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c1c9-3767-4223-a216-bd136361c99d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:47.946084 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c1c9-3767-4223-a216-bd136361c99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:47.965475 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f2a4c1c9-3767-4223-a216-bd136361c99d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:47.966741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f2a4c1c9-3767-4223-a216-bd136361c99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:48.027860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 925/1860] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:48.036978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7778-2063-4892-b7cc-353b90419370 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:48.037264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7778-2063-4892-b7cc-353b90419370 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:48.037535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de7778-2063-4892-b7cc-353b90419370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:48.056980 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-f2de7778-2063-4892-b7cc-353b90419370 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:48.058233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f2de7778-2063-4892-b7cc-353b90419370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:48.067847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 936/1861] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:48.072477 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4c1c9-3767-4223-a216-bd136361c99d None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:48.082673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4c1c9-3767-4223-a216-bd136361c99d None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:48.090120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1a017-9714-4610-b0a5-ee74e7028915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:48.090120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a017-9714-4610-b0a5-ee74e7028915 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:48.090120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a017-9714-4610-b0a5-ee74e7028915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:48.090120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1a017-9714-4610-b0a5-ee74e7028915 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:48.090483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1a017-9714-4610-b0a5-ee74e7028915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:48.090483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1a017-9714-4610-b0a5-ee74e7028915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:48.091904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1a017-9714-4610-b0a5-ee74e7028915 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:48.104272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 926/1862] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:48.108808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de7778-2063-4892-b7cc-353b90419370 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:48.118174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de7778-2063-4892-b7cc-353b90419370 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:48.124013 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e0eb7-aca2-439d-9d30-b730ade8d27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:48.124844 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0eb7-aca2-439d-9d30-b730ade8d27c admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:48.125193 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0eb7-aca2-439d-9d30-b730ade8d27c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:48.125599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e0eb7-aca2-439d-9d30-b730ade8d27c admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:48.126383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e0eb7-aca2-439d-9d30-b730ade8d27c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:48.129660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e0eb7-aca2-439d-9d30-b730ade8d27c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:48.177628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 937/1863] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:48 2021] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:48:48.181681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1a017-9714-4610-b0a5-ee74e7028915 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:48.197469 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1a017-9714-4610-b0a5-ee74e7028915 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:48.278344 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24e2a-da04-4970-a6d7-41ffc02a44f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:48.279027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24e2a-da04-4970-a6d7-41ffc02a44f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:48.279308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24e2a-da04-4970-a6d7-41ffc02a44f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:48.279583 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e24e2a-da04-4970-a6d7-41ffc02a44f6 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:48.280309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e24e2a-da04-4970-a6d7-41ffc02a44f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:48.282827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e24e2a-da04-4970-a6d7-41ffc02a44f6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:48.310596 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 927/1864] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:48 2021] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:48:48.315244 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e0eb7-aca2-439d-9d30-b730ade8d27c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:48.328605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e0eb7-aca2-439d-9d30-b730ade8d27c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:48.341222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332daa8-f4dd-4777-94fb-c801f2aa26e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:48.341938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332daa8-f4dd-4777-94fb-c801f2aa26e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:48.342222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332daa8-f4dd-4777-94fb-c801f2aa26e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:48.342496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332daa8-f4dd-4777-94fb-c801f2aa26e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:48.343248 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332daa8-f4dd-4777-94fb-c801f2aa26e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:48.344894 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332daa8-f4dd-4777-94fb-c801f2aa26e8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:48.358738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 938/1865] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:48 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:48.363179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24e2a-da04-4970-a6d7-41ffc02a44f6 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:48.373582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e24e2a-da04-4970-a6d7-41ffc02a44f6 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:48.379826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d37cd-024c-4580-917e-0482e47e852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:48.380519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d37cd-024c-4580-917e-0482e47e852c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:48.380835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d37cd-024c-4580-917e-0482e47e852c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:48.381143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d37cd-024c-4580-917e-0482e47e852c admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:48.381849 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d37cd-024c-4580-917e-0482e47e852c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:48.383459 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d37cd-024c-4580-917e-0482e47e852c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:48.395205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 928/1866] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:48.399647 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332daa8-f4dd-4777-94fb-c801f2aa26e8 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:48.410393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332daa8-f4dd-4777-94fb-c801f2aa26e8 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:48.415755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908674-97ba-4bfb-bdc5-4429def9e07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:48.416163 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908674-97ba-4bfb-bdc5-4429def9e07b admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:48.416450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908674-97ba-4bfb-bdc5-4429def9e07b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:48.416763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f908674-97ba-4bfb-bdc5-4429def9e07b admin admin] PATH_INFO: `/v3/projects/e808966b287d4d19810c0ccf507096a0/users/3b52ea82535c4692acfb0764000b0af0/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:48.432963 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f908674-97ba-4bfb-bdc5-4429def9e07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e808966b287d4d19810c0ccf507096a0, user_id=3b52ea82535c4692acfb0764000b0af0, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:48.436488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f908674-97ba-4bfb-bdc5-4429def9e07b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:48.453032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 939/1867] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:48 2021] PUT /identity/v3/projects/e808966b287d4d19810c0ccf507096a0/users/3b52ea82535c4692acfb0764000b0af0/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:48.465246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615d987-1345-49b4-a2b1-d24b45b8762e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:48.465496 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615d987-1345-49b4-a2b1-d24b45b8762e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:48.465818 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615d987-1345-49b4-a2b1-d24b45b8762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:48.497743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-b615d987-1345-49b4-a2b1-d24b45b8762e None None] MFA Rules not processed for user `3b52ea82535c4692acfb0764000b0af0`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:48.498879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b615d987-1345-49b4-a2b1-d24b45b8762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:48.576273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 929/1868] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:48 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:48.581796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908674-97ba-4bfb-bdc5-4429def9e07b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:48.663969 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f908674-97ba-4bfb-bdc5-4429def9e07b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:48.671797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5600e-f3b6-43e3-b13b-7174a29eb48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:48.672761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5600e-f3b6-43e3-b13b-7174a29eb48c admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:48.673069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5600e-f3b6-43e3-b13b-7174a29eb48c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:48.673318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b5600e-f3b6-43e3-b13b-7174a29eb48c admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:48.674189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5600e-f3b6-43e3-b13b-7174a29eb48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:48.676408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b5600e-f3b6-43e3-b13b-7174a29eb48c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:48.721627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 940/1869] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:48 2021] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:48.723030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615d987-1345-49b4-a2b1-d24b45b8762e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:48.744080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615d987-1345-49b4-a2b1-d24b45b8762e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:48.860872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a824baf-1cea-40a2-b1e3-8dac060cfc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:48.861721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a824baf-1cea-40a2-b1e3-8dac060cfc1f admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:48.862009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a824baf-1cea-40a2-b1e3-8dac060cfc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:48.862287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a824baf-1cea-40a2-b1e3-8dac060cfc1f admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:48.863560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a824baf-1cea-40a2-b1e3-8dac060cfc1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:48.866086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a824baf-1cea-40a2-b1e3-8dac060cfc1f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:48.901542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 930/1870] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:48 2021] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:48:48.906206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5600e-f3b6-43e3-b13b-7174a29eb48c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:48.929753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b5600e-f3b6-43e3-b13b-7174a29eb48c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:48.929753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3df8d-e016-4bd7-a09c-1a56b9d65dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:48.929753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3df8d-e016-4bd7-a09c-1a56b9d65dac admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:48.929753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3df8d-e016-4bd7-a09c-1a56b9d65dac admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:48.930157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3df8d-e016-4bd7-a09c-1a56b9d65dac admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:48.930157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3df8d-e016-4bd7-a09c-1a56b9d65dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:48.930157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3df8d-e016-4bd7-a09c-1a56b9d65dac admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:48.945712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 941/1871] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:48 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:48:48.950504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a824baf-1cea-40a2-b1e3-8dac060cfc1f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:48.987251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a824baf-1cea-40a2-b1e3-8dac060cfc1f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:49.028626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f51eb3-5429-4c69-9571-3bdd2eaa67d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:49.028626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f51eb3-5429-4c69-9571-3bdd2eaa67d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:49.028626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f51eb3-5429-4c69-9571-3bdd2eaa67d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:49.028626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f51eb3-5429-4c69-9571-3bdd2eaa67d0 admin admin] PATH_INFO: `/v3/projects/3ea2a76c99ce480ea334129164e8d309/users/799629ff3fac474eb229f13a7e01edf0/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:49.061208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f51eb3-5429-4c69-9571-3bdd2eaa67d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea2a76c99ce480ea334129164e8d309, user_id=799629ff3fac474eb229f13a7e01edf0, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:49.063996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f51eb3-5429-4c69-9571-3bdd2eaa67d0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:49.086809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 931/1872] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:48 2021] PUT /identity/v3/projects/3ea2a76c99ce480ea334129164e8d309/users/799629ff3fac474eb229f13a7e01edf0/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:49.090707 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3df8d-e016-4bd7-a09c-1a56b9d65dac admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:49.110433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3df8d-e016-4bd7-a09c-1a56b9d65dac admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:49.288509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee0a33-7cea-4f5e-b6a9-d29dee5a59ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:49.289404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee0a33-7cea-4f5e-b6a9-d29dee5a59ac admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:49.289859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee0a33-7cea-4f5e-b6a9-d29dee5a59ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:49.290014 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee0a33-7cea-4f5e-b6a9-d29dee5a59ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:49.290767 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee0a33-7cea-4f5e-b6a9-d29dee5a59ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:49.292407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee0a33-7cea-4f5e-b6a9-d29dee5a59ac admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:49.303627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 942/1873] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:49 2021] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:49.307621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f51eb3-5429-4c69-9571-3bdd2eaa67d0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:49.319014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f51eb3-5429-4c69-9571-3bdd2eaa67d0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:49.326529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2f27a-78df-485d-95d7-344772e8d9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:49.327523 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2f27a-78df-485d-95d7-344772e8d9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:49.327901 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2f27a-78df-485d-95d7-344772e8d9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:49.328264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2f27a-78df-485d-95d7-344772e8d9b1 admin admin] PATH_INFO: `/v3/projects/3ea2a76c99ce480ea334129164e8d309/users/799629ff3fac474eb229f13a7e01edf0/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:49.330611 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2f27a-78df-485d-95d7-344772e8d9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea2a76c99ce480ea334129164e8d309, user_id=799629ff3fac474eb229f13a7e01edf0, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:49.333495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2f27a-78df-485d-95d7-344772e8d9b1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:49.346756 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 932/1874] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:49 2021] PUT /identity/v3/projects/3ea2a76c99ce480ea334129164e8d309/users/799629ff3fac474eb229f13a7e01edf0/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:49.358295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4332-f725-4017-a313-5740f5c2d309 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:49.358669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4332-f725-4017-a313-5740f5c2d309 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:49.359119 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf4332-f725-4017-a313-5740f5c2d309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:49.406183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-51bf4332-f725-4017-a313-5740f5c2d309 None None] MFA Rules not processed for user `799629ff3fac474eb229f13a7e01edf0`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:49.407545 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-51bf4332-f725-4017-a313-5740f5c2d309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:49.493435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 943/1875] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:49 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:49.504834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2f27a-78df-485d-95d7-344772e8d9b1 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:49.506620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a6e2f27a-78df-485d-95d7-344772e8d9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:49.583764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2f27a-78df-485d-95d7-344772e8d9b1 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:49.589456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5e106-6b06-41ec-9281-ed2f50e9dba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:49.590405 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5e106-6b06-41ec-9281-ed2f50e9dba8 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:49.590729 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5e106-6b06-41ec-9281-ed2f50e9dba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:49.590975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5e106-6b06-41ec-9281-ed2f50e9dba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:49.602228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5e106-6b06-41ec-9281-ed2f50e9dba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:49.603773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5e106-6b06-41ec-9281-ed2f50e9dba8 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:49.614628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 933/1876] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:49 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:49.646462 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4332-f725-4017-a313-5740f5c2d309 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:49.715899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf4332-f725-4017-a313-5740f5c2d309 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:49.720710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:49.721632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:49.721906 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:49.722175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] PATH_INFO: `/v3/users/3b52ea82535c4692acfb0764000b0af0` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:49.723415 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b52ea82535c4692acfb0764000b0af0)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:49.725384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:49.793391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b52ea82535c4692acfb0764000b0af0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:49.800942 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b52ea82535c4692acfb0764000b0af0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:49.801692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b52ea82535c4692acfb0764000b0af0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:49.808909 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b52ea82535c4692acfb0764000b0af0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:49.818753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b52ea82535c4692acfb0764000b0af0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:49.825888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 944/1877] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:49 2021] DELETE /identity/v3/users/3b52ea82535c4692acfb0764000b0af0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:49.831379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520959fb-20f7-4ebc-a219-86fa9bbcfe7c None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:49.831379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520959fb-20f7-4ebc-a219-86fa9bbcfe7c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:49.831723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520959fb-20f7-4ebc-a219-86fa9bbcfe7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:49.852475 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-520959fb-20f7-4ebc-a219-86fa9bbcfe7c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:49.853878 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-520959fb-20f7-4ebc-a219-86fa9bbcfe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:49.919344 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 934/1878] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:49.930091 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:49.931765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:49.991521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c006d8-4b1b-4cb2-8185-e31fec427ee3 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:49.995242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e864825-3e8a-4381-9aa3-c1ae917b3798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:49.995890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e864825-3e8a-4381-9aa3-c1ae917b3798 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:49.996166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e864825-3e8a-4381-9aa3-c1ae917b3798 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:49.996435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e864825-3e8a-4381-9aa3-c1ae917b3798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:50.007019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e864825-3e8a-4381-9aa3-c1ae917b3798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:50.008836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e864825-3e8a-4381-9aa3-c1ae917b3798 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:50.020872 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 945/1879] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:50.461407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520959fb-20f7-4ebc-a219-86fa9bbcfe7c None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:50.463062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-520959fb-20f7-4ebc-a219-86fa9bbcfe7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:50.475753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520959fb-20f7-4ebc-a219-86fa9bbcfe7c None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:50.480529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:50.486664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:50.486664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:50.486664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] PATH_INFO: `/v3/projects/e808966b287d4d19810c0ccf507096a0` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:50.486664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e808966b287d4d19810c0ccf507096a0)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:50.486664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:50.539007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e808966b287d4d19810c0ccf507096a0', 'request_id': 'req-914a9c49-0655-4643-857e-dc37e1e6df2b'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:50.548441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e808966b287d4d19810c0ccf507096a0', 'request_id': 'req-914a9c49-0655-4643-857e-dc37e1e6df2b'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:50.557795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e808966b287d4d19810c0ccf507096a0', 'request_id': 'req-914a9c49-0655-4643-857e-dc37e1e6df2b'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:50.574173 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] The token cache is being invalidate because project e808966b287d4d19810c0ccf507096a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:50.574640 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:50.575568 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:50.578215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 935/1880] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:50 2021] DELETE /identity/v3/projects/e808966b287d4d19810c0ccf507096a0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:50.583272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e864825-3e8a-4381-9aa3-c1ae917b3798 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:50.594499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e864825-3e8a-4381-9aa3-c1ae917b3798 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:50.664211 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265d0dd-33a2-4c83-9773-ac8f9c8e51d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:50.665634 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265d0dd-33a2-4c83-9773-ac8f9c8e51d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:50.666080 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265d0dd-33a2-4c83-9773-ac8f9c8e51d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:50.666511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265d0dd-33a2-4c83-9773-ac8f9c8e51d2 admin admin] PATH_INFO: `/v3/users/799629ff3fac474eb229f13a7e01edf0` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:50.668406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265d0dd-33a2-4c83-9773-ac8f9c8e51d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=799629ff3fac474eb229f13a7e01edf0)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:50.671651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265d0dd-33a2-4c83-9773-ac8f9c8e51d2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:50.738408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b265d0dd-33a2-4c83-9773-ac8f9c8e51d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '799629ff3fac474eb229f13a7e01edf0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:50.752288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b265d0dd-33a2-4c83-9773-ac8f9c8e51d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '799629ff3fac474eb229f13a7e01edf0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:50.753157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b265d0dd-33a2-4c83-9773-ac8f9c8e51d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '799629ff3fac474eb229f13a7e01edf0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:50.762282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b265d0dd-33a2-4c83-9773-ac8f9c8e51d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '799629ff3fac474eb229f13a7e01edf0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:50.773117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b265d0dd-33a2-4c83-9773-ac8f9c8e51d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '799629ff3fac474eb229f13a7e01edf0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:50.781393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 946/1881] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:50 2021] DELETE /identity/v3/users/799629ff3fac474eb229f13a7e01edf0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:48:51.082462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:51.083940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:51.097022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a9c49-0655-4643-857e-dc37e1e6df2b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:51.176489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:51.177578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:51.184289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:51.184289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] PATH_INFO: `/v3/projects/3ea2a76c99ce480ea334129164e8d309` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:51.184289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea2a76c99ce480ea334129164e8d309)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:51.184289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:51.234691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea2a76c99ce480ea334129164e8d309', 'request_id': 'req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:51.243839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea2a76c99ce480ea334129164e8d309', 'request_id': 'req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:51.252978 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea2a76c99ce480ea334129164e8d309', 'request_id': 'req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:51.265698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] The token cache is being invalidate because project 3ea2a76c99ce480ea334129164e8d309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:51.265980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:51.266636 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-82cf46fb-bf22-4276-b5f9-532f31b8ecbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:51.269044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 936/1882] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:51 2021] DELETE /identity/v3/projects/3ea2a76c99ce480ea334129164e8d309 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:48:51.276308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7f47-5f45-4092-a7b9-9aeca00ab0c5 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:51.277877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7f47-5f45-4092-a7b9-9aeca00ab0c5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:51.278915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7f47-5f45-4092-a7b9-9aeca00ab0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:51.324793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-36bc7f47-5f45-4092-a7b9-9aeca00ab0c5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:51.327837 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-36bc7f47-5f45-4092-a7b9-9aeca00ab0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:51.432143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 947/1883] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:51.441809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55700c-520b-4889-b4d3-cc303471e87e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:51.442174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55700c-520b-4889-b4d3-cc303471e87e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:51.442449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55700c-520b-4889-b4d3-cc303471e87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:51.482474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-fa55700c-520b-4889-b4d3-cc303471e87e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:51.487353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fa55700c-520b-4889-b4d3-cc303471e87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:51.513048 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 937/1884] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:51.517015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc7f47-5f45-4092-a7b9-9aeca00ab0c5 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:51.532601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc7f47-5f45-4092-a7b9-9aeca00ab0c5 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:51.543571 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21dbcf7-59a7-4245-b1d7-9b5e24e2b49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:51.544342 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dbcf7-59a7-4245-b1d7-9b5e24e2b49b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:51.544650 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dbcf7-59a7-4245-b1d7-9b5e24e2b49b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:51.544950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21dbcf7-59a7-4245-b1d7-9b5e24e2b49b admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:51.545768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dbcf7-59a7-4245-b1d7-9b5e24e2b49b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:51.546074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dbcf7-59a7-4245-b1d7-9b5e24e2b49b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:51.548020 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21dbcf7-59a7-4245-b1d7-9b5e24e2b49b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:51.562230 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 948/1885] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:51.570811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55700c-520b-4889-b4d3-cc303471e87e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:51.592753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55700c-520b-4889-b4d3-cc303471e87e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:51.598445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a20b91-aa6b-4229-963d-6f152218f507 None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:51.599126 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a20b91-aa6b-4229-963d-6f152218f507 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:51.599506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a20b91-aa6b-4229-963d-6f152218f507 None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:51.605498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 949/1886] 10.222.0.62 () {54 vars in 921 bytes} [Mon Dec 13 16:48:51 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:48:51.622672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f40e16-df76-4c7c-9159-f73a41637987 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:51.623324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f40e16-df76-4c7c-9159-f73a41637987 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:51.623995 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f40e16-df76-4c7c-9159-f73a41637987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:51.626622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef940de1-5c00-47bf-bcc2-fda80717f9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:51.628132 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef940de1-5c00-47bf-bcc2-fda80717f9ad admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:51.628352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef940de1-5c00-47bf-bcc2-fda80717f9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:51.628792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef940de1-5c00-47bf-bcc2-fda80717f9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:51.630211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef940de1-5c00-47bf-bcc2-fda80717f9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:51.634367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef940de1-5c00-47bf-bcc2-fda80717f9ad admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:51.682066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-94f40e16-df76-4c7c-9159-f73a41637987 None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:51.683539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-94f40e16-df76-4c7c-9159-f73a41637987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:51.693858 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 938/1887] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:51 2021] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:51.697828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef940de1-5c00-47bf-bcc2-fda80717f9ad admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:51.803261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef940de1-5c00-47bf-bcc2-fda80717f9ad admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:51.810509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c3c55-bb81-445a-8877-5132bb23d105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:51.811500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3c55-bb81-445a-8877-5132bb23d105 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:51.813070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3c55-bb81-445a-8877-5132bb23d105 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:51.813689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c3c55-bb81-445a-8877-5132bb23d105 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:51.815312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c3c55-bb81-445a-8877-5132bb23d105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:51.823136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78c3c55-bb81-445a-8877-5132bb23d105 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:51.855286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 950/1888] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Dec 13 16:48:51 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:51.857670 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 939/1889] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:51 2021] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:48:51.860773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f40e16-df76-4c7c-9159-f73a41637987 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:51.875294 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f40e16-df76-4c7c-9159-f73a41637987 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:51.884477 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc3b3-c01d-4bd7-9445-46b928ed8ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:51.885217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc3b3-c01d-4bd7-9445-46b928ed8ccd admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:51.885497 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc3b3-c01d-4bd7-9445-46b928ed8ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:51.885835 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fc3b3-c01d-4bd7-9445-46b928ed8ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:51.886588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fc3b3-c01d-4bd7-9445-46b928ed8ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:51.888181 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fc3b3-c01d-4bd7-9445-46b928ed8ccd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:51.906004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c3c55-bb81-445a-8877-5132bb23d105 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:51.917997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78c3c55-bb81-445a-8877-5132bb23d105 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:51.918511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 951/1890] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:51 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:51.919576 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc3b3-c01d-4bd7-9445-46b928ed8ccd admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:51.922144 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1b7fc3b3-c01d-4bd7-9445-46b928ed8ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:51.938885 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48035b10-004a-49a7-b761-9c1fd4ef7bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:51.939700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48035b10-004a-49a7-b761-9c1fd4ef7bdc admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:51.940494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48035b10-004a-49a7-b761-9c1fd4ef7bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:51.940816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48035b10-004a-49a7-b761-9c1fd4ef7bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:51.941642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48035b10-004a-49a7-b761-9c1fd4ef7bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:51.943808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48035b10-004a-49a7-b761-9c1fd4ef7bdc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:51.957549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 940/1891] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:51 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:51.961998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48035b10-004a-49a7-b761-9c1fd4ef7bdc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:51.972836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48035b10-004a-49a7-b761-9c1fd4ef7bdc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:51.978412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04e5e6-4f78-488c-a1fc-b0421cb604fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:51.979326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04e5e6-4f78-488c-a1fc-b0421cb604fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:51.979609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04e5e6-4f78-488c-a1fc-b0421cb604fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:51.980401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04e5e6-4f78-488c-a1fc-b0421cb604fe admin admin] PATH_INFO: `/v3/projects/be235bfab3414311ad861f248d65da1a/users/fcee6571623540768410bf5d12fc3832/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.001569 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04e5e6-4f78-488c-a1fc-b0421cb604fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=be235bfab3414311ad861f248d65da1a, user_id=fcee6571623540768410bf5d12fc3832, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:52.005655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b04e5e6-4f78-488c-a1fc-b0421cb604fe admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:52.025324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 941/1892] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:51 2021] PUT /identity/v3/projects/be235bfab3414311ad861f248d65da1a/users/fcee6571623540768410bf5d12fc3832/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:52.039100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c4b8-9894-4e61-9349-ad9076f0a19e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.040280 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c4b8-9894-4e61-9349-ad9076f0a19e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.040843 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84c4b8-9894-4e61-9349-ad9076f0a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.042782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fc3b3-c01d-4bd7-9445-46b928ed8ccd admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:52.090282 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-cd84c4b8-9894-4e61-9349-ad9076f0a19e None None] MFA Rules not processed for user `fcee6571623540768410bf5d12fc3832`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:52.092214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-cd84c4b8-9894-4e61-9349-ad9076f0a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:52.212112 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52023f0-edb3-441b-8e0d-343e59cfd3c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:52.213451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52023f0-edb3-441b-8e0d-343e59cfd3c5 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.214045 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52023f0-edb3-441b-8e0d-343e59cfd3c5 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.214437 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52023f0-edb3-441b-8e0d-343e59cfd3c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.239530 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52023f0-edb3-441b-8e0d-343e59cfd3c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:52.242890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52023f0-edb3-441b-8e0d-343e59cfd3c5 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:52.257087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 942/1893] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:52 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:52.263968 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84c4b8-9894-4e61-9349-ad9076f0a19e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:52.267550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 952/1894] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:51 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:52.398701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84c4b8-9894-4e61-9349-ad9076f0a19e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:52.405455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46f828-4db6-4b2f-b494-9ac781d273f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:52.406213 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f828-4db6-4b2f-b494-9ac781d273f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.406520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f828-4db6-4b2f-b494-9ac781d273f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.406766 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f828-4db6-4b2f-b494-9ac781d273f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.407520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46f828-4db6-4b2f-b494-9ac781d273f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:52.409503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46f828-4db6-4b2f-b494-9ac781d273f4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:52.443027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 943/1895] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:52 2021] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:52.447237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52023f0-edb3-441b-8e0d-343e59cfd3c5 service nova] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:52.457923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52023f0-edb3-441b-8e0d-343e59cfd3c5 service nova] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:52.515205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42dad-ff78-49fb-b455-a8e50ddd84b3 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.515719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42dad-ff78-49fb-b455-a8e50ddd84b3 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.515808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42dad-ff78-49fb-b455-a8e50ddd84b3 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.517571 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 944/1896] 10.222.0.62 () {54 vars in 921 bytes} [Mon Dec 13 16:48:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Dec 13 16:48:52.529332 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2ca52-a77d-4633-8b78-d833934f0303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:52.530300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2ca52-a77d-4633-8b78-d833934f0303 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.530680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2ca52-a77d-4633-8b78-d833934f0303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.530954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2ca52-a77d-4633-8b78-d833934f0303 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.531665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2ca52-a77d-4633-8b78-d833934f0303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:52.534532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2ca52-a77d-4633-8b78-d833934f0303 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:52.546568 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbcda7-49b7-4a89-9a92-369c6f45d540 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.546985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbcda7-49b7-4a89-9a92-369c6f45d540 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.547348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbcda7-49b7-4a89-9a92-369c6f45d540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.577505 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 953/1897] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:52 2021] POST /identity/v3/users => generated 300 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:52.578641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2ca52-a77d-4633-8b78-d833934f0303 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:52.583152 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-69fbcda7-49b7-4a89-9a92-369c6f45d540 None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:52.584495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-69fbcda7-49b7-4a89-9a92-369c6f45d540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:52.596506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2ca52-a77d-4633-8b78-d833934f0303 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:52.604987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36319a-a437-4817-a4c8-30281feae300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:52.606709 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36319a-a437-4817-a4c8-30281feae300 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.607888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36319a-a437-4817-a4c8-30281feae300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.608386 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36319a-a437-4817-a4c8-30281feae300 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.609425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36319a-a437-4817-a4c8-30281feae300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:52.611554 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36319a-a437-4817-a4c8-30281feae300 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:52.624754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 954/1898] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:52 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:48:52.629401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36319a-a437-4817-a4c8-30281feae300 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:52.652762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36319a-a437-4817-a4c8-30281feae300 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:52.657996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e913d-2f1c-427d-b111-63a9a72db550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:52.659198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e913d-2f1c-427d-b111-63a9a72db550 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.659575 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e913d-2f1c-427d-b111-63a9a72db550 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.659950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4e913d-2f1c-427d-b111-63a9a72db550 admin admin] PATH_INFO: `/v3/projects/bd38a9598d784b05911c4214b0240ed8/users/0a4b1688679548f1932c8637702a3265/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.683875 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 945/1899] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Dec 13 16:48:52 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:48:52.698974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e913d-2f1c-427d-b111-63a9a72db550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd38a9598d784b05911c4214b0240ed8, user_id=0a4b1688679548f1932c8637702a3265, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:52.704009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbcda7-49b7-4a89-9a92-369c6f45d540 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:52.706157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4e913d-2f1c-427d-b111-63a9a72db550 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:52.725187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbcda7-49b7-4a89-9a92-369c6f45d540 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:52.726733 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 955/1900] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:52 2021] PUT /identity/v3/projects/bd38a9598d784b05911c4214b0240ed8/users/0a4b1688679548f1932c8637702a3265/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:52.731395 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e913d-2f1c-427d-b111-63a9a72db550 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:52.797295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4e913d-2f1c-427d-b111-63a9a72db550 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:52.800826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01157a0e-20ac-4c8b-a437-fb5a4e9d9982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:52.801473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157a0e-20ac-4c8b-a437-fb5a4e9d9982 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.801753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157a0e-20ac-4c8b-a437-fb5a4e9d9982 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.802017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01157a0e-20ac-4c8b-a437-fb5a4e9d9982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.802801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e20618-8bc2-4834-8d6a-cd9eeaf6b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:52.803465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20618-8bc2-4834-8d6a-cd9eeaf6b78b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.803745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20618-8bc2-4834-8d6a-cd9eeaf6b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.804019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20618-8bc2-4834-8d6a-cd9eeaf6b78b admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.804787 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e20618-8bc2-4834-8d6a-cd9eeaf6b78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:52.806390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e20618-8bc2-4834-8d6a-cd9eeaf6b78b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:52.812538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01157a0e-20ac-4c8b-a437-fb5a4e9d9982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:52.814648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01157a0e-20ac-4c8b-a437-fb5a4e9d9982 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:52.818002 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 956/1901] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:52 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:48:52.823843 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e20618-8bc2-4834-8d6a-cd9eeaf6b78b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:52.828315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 946/1902] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:52 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:52.837011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e20618-8bc2-4834-8d6a-cd9eeaf6b78b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:52.845254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e54eb4-2406-4f93-8307-00f6afbdd5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:52.847695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e54eb4-2406-4f93-8307-00f6afbdd5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.847966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e54eb4-2406-4f93-8307-00f6afbdd5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.848242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e54eb4-2406-4f93-8307-00f6afbdd5cd admin admin] PATH_INFO: `/v3/projects/bd38a9598d784b05911c4214b0240ed8/users/0a4b1688679548f1932c8637702a3265/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.850629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e54eb4-2406-4f93-8307-00f6afbdd5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd38a9598d784b05911c4214b0240ed8, user_id=0a4b1688679548f1932c8637702a3265, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:52.853298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e54eb4-2406-4f93-8307-00f6afbdd5cd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:52.865421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 957/1903] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:52 2021] PUT /identity/v3/projects/bd38a9598d784b05911c4214b0240ed8/users/0a4b1688679548f1932c8637702a3265/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:48:52.878296 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bf831-0f12-4d55-800d-d2ded83d6057 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:52.878564 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bf831-0f12-4d55-800d-d2ded83d6057 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:52.878839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bf831-0f12-4d55-800d-d2ded83d6057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:52.911342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d70bf831-0f12-4d55-800d-d2ded83d6057 None None] MFA Rules not processed for user `0a4b1688679548f1932c8637702a3265`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:52.912542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d70bf831-0f12-4d55-800d-d2ded83d6057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:53.013989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 947/1904] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:52 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:53.031078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e54eb4-2406-4f93-8307-00f6afbdd5cd admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:53.033351 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-30e54eb4-2406-4f93-8307-00f6afbdd5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:53.109203 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e54eb4-2406-4f93-8307-00f6afbdd5cd admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:53.113951 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bea43-764f-4d3b-abf4-1a44f0e73238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:53.114638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bea43-764f-4d3b-abf4-1a44f0e73238 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:53.114923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bea43-764f-4d3b-abf4-1a44f0e73238 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:53.115192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bea43-764f-4d3b-abf4-1a44f0e73238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:53.126555 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bea43-764f-4d3b-abf4-1a44f0e73238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:53.128201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bea43-764f-4d3b-abf4-1a44f0e73238 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:53.140349 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 958/1905] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:53 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:53.234092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bf831-0f12-4d55-800d-d2ded83d6057 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:53.313852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70bf831-0f12-4d55-800d-d2ded83d6057 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:53.321104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:53.322056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:53.322465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:53.322744 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] PATH_INFO: `/v3/users/fcee6571623540768410bf5d12fc3832` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:53.324482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcee6571623540768410bf5d12fc3832)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:53.326992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:53.389542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcee6571623540768410bf5d12fc3832'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:53.404959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcee6571623540768410bf5d12fc3832'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:53.414104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcee6571623540768410bf5d12fc3832'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:53.424958 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcee6571623540768410bf5d12fc3832'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:53.425898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcee6571623540768410bf5d12fc3832'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:53.433499 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 948/1906] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:53 2021] DELETE /identity/v3/users/fcee6571623540768410bf5d12fc3832 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:53.444684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591272b6-a539-4f0f-bb5d-e986c8392586 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:53.444684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591272b6-a539-4f0f-bb5d-e986c8392586 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:53.444684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591272b6-a539-4f0f-bb5d-e986c8392586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:53.462791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-591272b6-a539-4f0f-bb5d-e986c8392586 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:53.464001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-591272b6-a539-4f0f-bb5d-e986c8392586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:53.537044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 959/1907] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:53.549747 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:53.551516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:53.630463 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ac7cc-e0fd-4a41-ba39-9d2989942f1d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:53.636785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6325a-8ff9-4a83-95d9-9b0c07f6598b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:53.637580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6325a-8ff9-4a83-95d9-9b0c07f6598b service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:53.637960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6325a-8ff9-4a83-95d9-9b0c07f6598b service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:53.638400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6325a-8ff9-4a83-95d9-9b0c07f6598b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:53.649706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6325a-8ff9-4a83-95d9-9b0c07f6598b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:53.651259 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6325a-8ff9-4a83-95d9-9b0c07f6598b service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:53.661845 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 949/1908] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:54.009019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591272b6-a539-4f0f-bb5d-e986c8392586 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:54.011283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-591272b6-a539-4f0f-bb5d-e986c8392586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:54.025822 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591272b6-a539-4f0f-bb5d-e986c8392586 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:54.032881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:54.034233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:54.034456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:54.034730 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] PATH_INFO: `/v3/projects/be235bfab3414311ad861f248d65da1a` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:54.036753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be235bfab3414311ad861f248d65da1a)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:54.038467 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:54.097392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be235bfab3414311ad861f248d65da1a', 'request_id': 'req-851f39bf-b92d-41d3-95d8-993eef209c47'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:54.106289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be235bfab3414311ad861f248d65da1a', 'request_id': 'req-851f39bf-b92d-41d3-95d8-993eef209c47'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:54.114296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be235bfab3414311ad861f248d65da1a', 'request_id': 'req-851f39bf-b92d-41d3-95d8-993eef209c47'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:54.125756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] The token cache is being invalidate because project be235bfab3414311ad861f248d65da1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:54.126039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:54.126765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:54.128703 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 960/1909] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:54 2021] DELETE /identity/v3/projects/be235bfab3414311ad861f248d65da1a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:54.134523 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6325a-8ff9-4a83-95d9-9b0c07f6598b service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:54.145611 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6325a-8ff9-4a83-95d9-9b0c07f6598b service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:54.223723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab516b-0f16-4d81-a7d2-f6aae7ad47a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:54.225461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab516b-0f16-4d81-a7d2-f6aae7ad47a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:54.225849 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab516b-0f16-4d81-a7d2-f6aae7ad47a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:54.226194 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab516b-0f16-4d81-a7d2-f6aae7ad47a0 admin admin] PATH_INFO: `/v3/users/0a4b1688679548f1932c8637702a3265` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:54.228169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab516b-0f16-4d81-a7d2-f6aae7ad47a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4b1688679548f1932c8637702a3265)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:54.231235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bab516b-0f16-4d81-a7d2-f6aae7ad47a0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:54.304089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0bab516b-0f16-4d81-a7d2-f6aae7ad47a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4b1688679548f1932c8637702a3265'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:54.315956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0bab516b-0f16-4d81-a7d2-f6aae7ad47a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4b1688679548f1932c8637702a3265'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:54.330016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0bab516b-0f16-4d81-a7d2-f6aae7ad47a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4b1688679548f1932c8637702a3265'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:54.343963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0bab516b-0f16-4d81-a7d2-f6aae7ad47a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4b1688679548f1932c8637702a3265'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:54.345467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0bab516b-0f16-4d81-a7d2-f6aae7ad47a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4b1688679548f1932c8637702a3265'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:54.362690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 950/1910] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:54 2021] DELETE /identity/v3/users/0a4b1688679548f1932c8637702a3265 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:55.241260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:55.242779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:55.259859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f39bf-b92d-41d3-95d8-993eef209c47 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:55.328536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:55.329477 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:55.330462 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:55.330462 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] PATH_INFO: `/v3/projects/bd38a9598d784b05911c4214b0240ed8` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:55.331770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd38a9598d784b05911c4214b0240ed8)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:55.333742 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:55.394597 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd38a9598d784b05911c4214b0240ed8', 'request_id': 'req-21ddc601-91e4-4adc-ab8e-ec56bb337226'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:55.414471 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd38a9598d784b05911c4214b0240ed8', 'request_id': 'req-21ddc601-91e4-4adc-ab8e-ec56bb337226'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:55.421413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd38a9598d784b05911c4214b0240ed8', 'request_id': 'req-21ddc601-91e4-4adc-ab8e-ec56bb337226'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:55.433052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] The token cache is being invalidate because project bd38a9598d784b05911c4214b0240ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:55.433401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:55.434057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:55.436066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 961/1911] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:55 2021] DELETE /identity/v3/projects/bd38a9598d784b05911c4214b0240ed8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:55.442625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517bd3e-08f7-47fe-9add-ba8ce36a002e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:55.443155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517bd3e-08f7-47fe-9add-ba8ce36a002e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:55.443155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517bd3e-08f7-47fe-9add-ba8ce36a002e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:55.467957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c517bd3e-08f7-47fe-9add-ba8ce36a002e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:55.467957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c517bd3e-08f7-47fe-9add-ba8ce36a002e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:55.487089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:55.488766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:55.572270 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddc601-91e4-4adc-ab8e-ec56bb337226 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:55.578032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 951/1912] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:48:55.578627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46045576-94ac-486a-bbaa-a7019ffbc2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:55.579978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045576-94ac-486a-bbaa-a7019ffbc2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:55.580707 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045576-94ac-486a-bbaa-a7019ffbc2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:55.581198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46045576-94ac-486a-bbaa-a7019ffbc2fd admin admin] PATH_INFO: `/v3/users/df976cadcca245659415d89f5568e79c` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:55.582821 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46045576-94ac-486a-bbaa-a7019ffbc2fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=df976cadcca245659415d89f5568e79c)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:55.584840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46045576-94ac-486a-bbaa-a7019ffbc2fd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:55.589683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c685-354b-4fb5-b30a-91837823a30b None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:55.590084 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c685-354b-4fb5-b30a-91837823a30b None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:55.590382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588c685-354b-4fb5-b30a-91837823a30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:55.631535 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-2588c685-354b-4fb5-b30a-91837823a30b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:55.632784 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2588c685-354b-4fb5-b30a-91837823a30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:55.650002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 952/1913] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:55.657061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588c685-354b-4fb5-b30a-91837823a30b None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:55.678068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-46045576-94ac-486a-bbaa-a7019ffbc2fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df976cadcca245659415d89f5568e79c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:55.681264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588c685-354b-4fb5-b30a-91837823a30b None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:55.687129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39ca1-bac7-4688-a8a6-ec92071dcc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:55.687902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39ca1-bac7-4688-a8a6-ec92071dcc74 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:55.688265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39ca1-bac7-4688-a8a6-ec92071dcc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:55.688913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc39ca1-bac7-4688-a8a6-ec92071dcc74 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:55.689325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc39ca1-bac7-4688-a8a6-ec92071dcc74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:55.689627 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc39ca1-bac7-4688-a8a6-ec92071dcc74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:55.691675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc39ca1-bac7-4688-a8a6-ec92071dcc74 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:55.694428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-46045576-94ac-486a-bbaa-a7019ffbc2fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df976cadcca245659415d89f5568e79c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:55.695347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-46045576-94ac-486a-bbaa-a7019ffbc2fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df976cadcca245659415d89f5568e79c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:55.703405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-46045576-94ac-486a-bbaa-a7019ffbc2fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df976cadcca245659415d89f5568e79c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:55.710732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 953/1914] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:55.712256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39ca1-bac7-4688-a8a6-ec92071dcc74 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:55.713924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-46045576-94ac-486a-bbaa-a7019ffbc2fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df976cadcca245659415d89f5568e79c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:55.724675 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 962/1915] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:55 2021] DELETE /identity/v3/users/df976cadcca245659415d89f5568e79c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:48:55.724835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc39ca1-bac7-4688-a8a6-ec92071dcc74 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:55.727068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c90d4-caad-43bf-b460-6ad5a0ca6f09 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:55.728028 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c90d4-caad-43bf-b460-6ad5a0ca6f09 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:55.728437 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c90d4-caad-43bf-b460-6ad5a0ca6f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:55.751822 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e16c90d4-caad-43bf-b460-6ad5a0ca6f09 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:55.753262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e16c90d4-caad-43bf-b460-6ad5a0ca6f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:55.792829 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c62862-e59e-4f31-b2ee-0eb1b923d125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:55.793633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c62862-e59e-4f31-b2ee-0eb1b923d125 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:55.793961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c62862-e59e-4f31-b2ee-0eb1b923d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:55.794268 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c62862-e59e-4f31-b2ee-0eb1b923d125 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:55.795039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c62862-e59e-4f31-b2ee-0eb1b923d125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:55.797257 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c62862-e59e-4f31-b2ee-0eb1b923d125 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:55.854780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 954/1916] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:55 2021] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:55.857384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 963/1917] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:55.858725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c90d4-caad-43bf-b460-6ad5a0ca6f09 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:55.860166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e16c90d4-caad-43bf-b460-6ad5a0ca6f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:55.873243 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c62862-e59e-4f31-b2ee-0eb1b923d125 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:55.874159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c90d4-caad-43bf-b460-6ad5a0ca6f09 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:55.875506 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-50c62862-e59e-4f31-b2ee-0eb1b923d125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:55.943042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f8b5-690f-4432-9dcb-42c250166984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:55.943472 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f8b5-690f-4432-9dcb-42c250166984 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:55.943660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f8b5-690f-4432-9dcb-42c250166984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:55.943858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330f8b5-690f-4432-9dcb-42c250166984 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:55.944655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330f8b5-690f-4432-9dcb-42c250166984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:55.947260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330f8b5-690f-4432-9dcb-42c250166984 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:55.948456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c62862-e59e-4f31-b2ee-0eb1b923d125 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:55.953397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd313154-84b5-4aa8-bf4f-84561bbd35e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:55.954099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313154-84b5-4aa8-bf4f-84561bbd35e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:55.954403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313154-84b5-4aa8-bf4f-84561bbd35e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:55.954894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd313154-84b5-4aa8-bf4f-84561bbd35e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:55.966635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd313154-84b5-4aa8-bf4f-84561bbd35e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:55.968471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd313154-84b5-4aa8-bf4f-84561bbd35e1 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:55.971926 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 964/1918] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:55 2021] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:48:55.976121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f8b5-690f-4432-9dcb-42c250166984 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:55.980141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 955/1919] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:48:55.986573 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330f8b5-690f-4432-9dcb-42c250166984 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:55.993658 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03cccc-31d8-4029-a3ad-803dd538f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:55.994461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03cccc-31d8-4029-a3ad-803dd538f825 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:55.994794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03cccc-31d8-4029-a3ad-803dd538f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:55.995071 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03cccc-31d8-4029-a3ad-803dd538f825 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:55.995883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03cccc-31d8-4029-a3ad-803dd538f825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:55.998048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03cccc-31d8-4029-a3ad-803dd538f825 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:56.016605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 965/1920] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:55 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:48:56.020801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd313154-84b5-4aa8-bf4f-84561bbd35e1 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:56.030333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd313154-84b5-4aa8-bf4f-84561bbd35e1 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:56.036032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6141d86-4691-4af2-b783-322d655299d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:56.036809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6141d86-4691-4af2-b783-322d655299d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:56.037092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6141d86-4691-4af2-b783-322d655299d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:56.037363 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6141d86-4691-4af2-b783-322d655299d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:56.038106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6141d86-4691-4af2-b783-322d655299d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:56.040034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6141d86-4691-4af2-b783-322d655299d7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:56.053082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 956/1921] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:48:56.058148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03cccc-31d8-4029-a3ad-803dd538f825 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:56.076039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03cccc-31d8-4029-a3ad-803dd538f825 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:56.081301 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae9aad-0796-4158-955a-db0f7d0944a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:56.082412 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae9aad-0796-4158-955a-db0f7d0944a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:56.082698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae9aad-0796-4158-955a-db0f7d0944a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:56.083025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae9aad-0796-4158-955a-db0f7d0944a1 admin admin] PATH_INFO: `/v3/projects/6634e5fc5b134c7ebba735a6b13c3c6c/users/b4418b7ab10b434198311db6b8f7853e/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:56.102570 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae9aad-0796-4158-955a-db0f7d0944a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6634e5fc5b134c7ebba735a6b13c3c6c, user_id=b4418b7ab10b434198311db6b8f7853e, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:56.107359 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ae9aad-0796-4158-955a-db0f7d0944a1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:56.129461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 966/1922] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:56 2021] PUT /identity/v3/projects/6634e5fc5b134c7ebba735a6b13c3c6c/users/b4418b7ab10b434198311db6b8f7853e/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:48:56.147288 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578feb6-06b2-4304-b554-a0a2744480d8 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:56.147761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578feb6-06b2-4304-b554-a0a2744480d8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:56.148235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578feb6-06b2-4304-b554-a0a2744480d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:56.184141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-a578feb6-06b2-4304-b554-a0a2744480d8 None None] MFA Rules not processed for user `b4418b7ab10b434198311db6b8f7853e`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:56.186002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a578feb6-06b2-4304-b554-a0a2744480d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:56.274470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 957/1923] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:56 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:56.279085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae9aad-0796-4158-955a-db0f7d0944a1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:56.308578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578feb6-06b2-4304-b554-a0a2744480d8 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:56.310642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a578feb6-06b2-4304-b554-a0a2744480d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:56.405956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578feb6-06b2-4304-b554-a0a2744480d8 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:56.406496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae9aad-0796-4158-955a-db0f7d0944a1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:56.411807 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:56.412970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:56.413258 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:56.414237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] PATH_INFO: `/v3/projects/975bf46bffe744c3a416d6bab235f031` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:56.414346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd928a-fe54-4add-aa99-9316c0d3723f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:56.415040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd928a-fe54-4add-aa99-9316c0d3723f admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:56.415143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=975bf46bffe744c3a416d6bab235f031)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:56.415358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd928a-fe54-4add-aa99-9316c0d3723f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:56.415733 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd928a-fe54-4add-aa99-9316c0d3723f admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:56.416793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd928a-fe54-4add-aa99-9316c0d3723f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:56.417498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:56.419061 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd928a-fe54-4add-aa99-9316c0d3723f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:56.459169 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 967/1924] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:56 2021] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:48:56.463000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd928a-fe54-4add-aa99-9316c0d3723f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:56.482241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975bf46bffe744c3a416d6bab235f031', 'request_id': 'req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:56.491255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975bf46bffe744c3a416d6bab235f031', 'request_id': 'req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:56.498768 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975bf46bffe744c3a416d6bab235f031', 'request_id': 'req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:56.511424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] The token cache is being invalidate because project 975bf46bffe744c3a416d6bab235f031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:56.511801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:56.512431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:56.514057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 958/1925] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:56 2021] DELETE /identity/v3/projects/975bf46bffe744c3a416d6bab235f031 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:56.518330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:56.519852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:56.532108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd928a-fe54-4add-aa99-9316c0d3723f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:56.599052 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71c1bd-65b0-4ffb-919a-cdcbd80837f9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:56.600133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562021a9-3efb-4ba7-bfae-a9285f7ac4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:56.600854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562021a9-3efb-4ba7-bfae-a9285f7ac4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:56.601136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562021a9-3efb-4ba7-bfae-a9285f7ac4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:56.601409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562021a9-3efb-4ba7-bfae-a9285f7ac4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:56.602323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562021a9-3efb-4ba7-bfae-a9285f7ac4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:56.604482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562021a9-3efb-4ba7-bfae-a9285f7ac4d6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:56.606787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7a930c-9607-426a-b66b-58bd2f23cad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:56.608225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a930c-9607-426a-b66b-58bd2f23cad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:56.608714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a930c-9607-426a-b66b-58bd2f23cad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:56.609187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a930c-9607-426a-b66b-58bd2f23cad2 admin admin] PATH_INFO: `/v3/users/46f5f15aace44fc2a6d222b33ee9f6a2` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:56.610923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a930c-9607-426a-b66b-58bd2f23cad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f5f15aace44fc2a6d222b33ee9f6a2)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:56.615025 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7a930c-9607-426a-b66b-58bd2f23cad2 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:56.640196 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 968/1926] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:56 2021] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:56.646276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562021a9-3efb-4ba7-bfae-a9285f7ac4d6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:56.649155 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-562021a9-3efb-4ba7-bfae-a9285f7ac4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:56.668998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562021a9-3efb-4ba7-bfae-a9285f7ac4d6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:56.675524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53b17-0b62-4633-ac7a-3302262227df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:56.676201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53b17-0b62-4633-ac7a-3302262227df admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:56.676486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53b17-0b62-4633-ac7a-3302262227df admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:56.677071 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53b17-0b62-4633-ac7a-3302262227df admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:56.677810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb53b17-0b62-4633-ac7a-3302262227df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:56.679416 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb53b17-0b62-4633-ac7a-3302262227df admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:56.689812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bb7a930c-9607-426a-b66b-58bd2f23cad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f5f15aace44fc2a6d222b33ee9f6a2'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:56.693409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 969/1927] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:56 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:48:56.697950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53b17-0b62-4633-ac7a-3302262227df admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:56.704990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bb7a930c-9607-426a-b66b-58bd2f23cad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f5f15aace44fc2a6d222b33ee9f6a2'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:56.714226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53b17-0b62-4633-ac7a-3302262227df admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:56.717880 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bb7a930c-9607-426a-b66b-58bd2f23cad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f5f15aace44fc2a6d222b33ee9f6a2'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:56.720708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a13a4f-6ca0-4852-af2a-4db9b8af39c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:56.721814 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a13a4f-6ca0-4852-af2a-4db9b8af39c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:56.722102 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a13a4f-6ca0-4852-af2a-4db9b8af39c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:56.722385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a13a4f-6ca0-4852-af2a-4db9b8af39c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:56.723207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a13a4f-6ca0-4852-af2a-4db9b8af39c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:56.725105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a13a4f-6ca0-4852-af2a-4db9b8af39c9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:56.735691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bb7a930c-9607-426a-b66b-58bd2f23cad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f5f15aace44fc2a6d222b33ee9f6a2'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:56.737566 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bb7a930c-9607-426a-b66b-58bd2f23cad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f5f15aace44fc2a6d222b33ee9f6a2'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:56.744139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 970/1928] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:56 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:48:56.745001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a13a4f-6ca0-4852-af2a-4db9b8af39c9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:56.747639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f3a13a4f-6ca0-4852-af2a-4db9b8af39c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:56.751164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 959/1929] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:48:56 2021] DELETE /identity/v3/users/46f5f15aace44fc2a6d222b33ee9f6a2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:56.762316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a13a4f-6ca0-4852-af2a-4db9b8af39c9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:56.849698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5f937-f814-4651-b769-a92e94d1bf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:56.851581 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5f937-f814-4651-b769-a92e94d1bf17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:56.852106 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5f937-f814-4651-b769-a92e94d1bf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:56.852430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5f937-f814-4651-b769-a92e94d1bf17 admin admin] PATH_INFO: `/v3/projects/f1b4effb62c047c38a91772bc253ce75/users/f5a62c8406564580988c9f02ca62276c/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:56.872374 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5f937-f814-4651-b769-a92e94d1bf17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b4effb62c047c38a91772bc253ce75, user_id=f5a62c8406564580988c9f02ca62276c, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:56.875251 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5f937-f814-4651-b769-a92e94d1bf17 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:56.904859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 971/1930] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:56 2021] PUT /identity/v3/projects/f1b4effb62c047c38a91772bc253ce75/users/f5a62c8406564580988c9f02ca62276c/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:56.907030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca75a66-59c1-4dd5-831e-e546a05d815c None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:56.907415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca75a66-59c1-4dd5-831e-e546a05d815c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:56.907722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca75a66-59c1-4dd5-831e-e546a05d815c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:56.940346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7ca75a66-59c1-4dd5-831e-e546a05d815c None None] MFA Rules not processed for user `f5a62c8406564580988c9f02ca62276c`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:56.942103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7ca75a66-59c1-4dd5-831e-e546a05d815c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:57.027591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 960/1931] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:56 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:57.031941 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5f937-f814-4651-b769-a92e94d1bf17 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.109154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca75a66-59c1-4dd5-831e-e546a05d815c None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.110556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7ca75a66-59c1-4dd5-831e-e546a05d815c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:57.120948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5f937-f814-4651-b769-a92e94d1bf17 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.129032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb043ab-e8cb-4f37-9a0b-60a9d61541ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.129799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb043ab-e8cb-4f37-9a0b-60a9d61541ec admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.130133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb043ab-e8cb-4f37-9a0b-60a9d61541ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.130432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb043ab-e8cb-4f37-9a0b-60a9d61541ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.131131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb043ab-e8cb-4f37-9a0b-60a9d61541ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.133091 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb043ab-e8cb-4f37-9a0b-60a9d61541ec admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.136344 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca75a66-59c1-4dd5-831e-e546a05d815c None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.142401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.143617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.143848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.144123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] PATH_INFO: `/v3/projects/cbd0a01efc904478b82d7f1f30b88437` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.146304 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd0a01efc904478b82d7f1f30b88437)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.148498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.168147 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 972/1932] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:57 2021] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:57.169542 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb043ab-e8cb-4f37-9a0b-60a9d61541ec admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.210678 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd0a01efc904478b82d7f1f30b88437', 'request_id': 'req-19d11487-172c-487d-9c1c-6c2d3c0cbc84'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:57.221241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd0a01efc904478b82d7f1f30b88437', 'request_id': 'req-19d11487-172c-487d-9c1c-6c2d3c0cbc84'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:57.230626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd0a01efc904478b82d7f1f30b88437', 'request_id': 'req-19d11487-172c-487d-9c1c-6c2d3c0cbc84'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:57.242654 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb043ab-e8cb-4f37-9a0b-60a9d61541ec admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.244790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] The token cache is being invalidate because project cbd0a01efc904478b82d7f1f30b88437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:48:57.244790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:57.245421 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-19d11487-172c-487d-9c1c-6c2d3c0cbc84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:48:57.247689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 961/1933] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:48:57 2021] DELETE /identity/v3/projects/cbd0a01efc904478b82d7f1f30b88437 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:48:57.256920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b07d-48bb-4059-8cc4-2fed3b305dfe None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.256920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b07d-48bb-4059-8cc4-2fed3b305dfe None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.256920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a4b07d-48bb-4059-8cc4-2fed3b305dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.284311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f0a4b07d-48bb-4059-8cc4-2fed3b305dfe None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:57.286529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f0a4b07d-48bb-4059-8cc4-2fed3b305dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:57.333465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419aa1e-aa17-404e-bacc-36d3995822f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.335431 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419aa1e-aa17-404e-bacc-36d3995822f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.335804 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419aa1e-aa17-404e-bacc-36d3995822f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.336091 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419aa1e-aa17-404e-bacc-36d3995822f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.336812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419aa1e-aa17-404e-bacc-36d3995822f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.338862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419aa1e-aa17-404e-bacc-36d3995822f3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.364806 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 973/1934] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:57 2021] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:57.368629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 962/1935] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:48:57.368918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419aa1e-aa17-404e-bacc-36d3995822f3 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.370641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f419aa1e-aa17-404e-bacc-36d3995822f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:57.374056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d3d7c-1bf9-4ec8-80f6-b3eb7d18bde5 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.374861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d3d7c-1bf9-4ec8-80f6-b3eb7d18bde5 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.374975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d3d7c-1bf9-4ec8-80f6-b3eb7d18bde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.387341 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419aa1e-aa17-404e-bacc-36d3995822f3 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.392851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bda19-c141-4f8d-95c4-35e87b17853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.393859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bda19-c141-4f8d-95c4-35e87b17853c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.394137 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bda19-c141-4f8d-95c4-35e87b17853c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.394407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578bda19-c141-4f8d-95c4-35e87b17853c admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.395156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bda19-c141-4f8d-95c4-35e87b17853c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.396787 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578bda19-c141-4f8d-95c4-35e87b17853c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.397973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7a0d3d7c-1bf9-4ec8-80f6-b3eb7d18bde5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:57.399258 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7a0d3d7c-1bf9-4ec8-80f6-b3eb7d18bde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:57.408546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 963/1936] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:57.410563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 974/1937] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:57 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:57.413932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d3d7c-1bf9-4ec8-80f6-b3eb7d18bde5 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.415525 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bda19-c141-4f8d-95c4-35e87b17853c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.426180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578bda19-c141-4f8d-95c4-35e87b17853c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.426771 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d3d7c-1bf9-4ec8-80f6-b3eb7d18bde5 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.431285 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36873a6-896e-4549-b225-6dfe94c9edef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.432139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36873a6-896e-4549-b225-6dfe94c9edef admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.432421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36873a6-896e-4549-b225-6dfe94c9edef admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.432719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36873a6-896e-4549-b225-6dfe94c9edef admin admin] PATH_INFO: `/v3/projects/e41816ff4ec3477d8ebf54ef82115df6/users/aba75532be0b4afea1018908ac7111d7/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.433364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73398a99-bad0-4fc2-a6dc-a6f1d098a220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.434221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398a99-bad0-4fc2-a6dc-a6f1d098a220 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.434587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398a99-bad0-4fc2-a6dc-a6f1d098a220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.435068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73398a99-bad0-4fc2-a6dc-a6f1d098a220 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.436059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73398a99-bad0-4fc2-a6dc-a6f1d098a220 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:48:57.436503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73398a99-bad0-4fc2-a6dc-a6f1d098a220 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.438297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73398a99-bad0-4fc2-a6dc-a6f1d098a220 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.455289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 964/1938] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:48:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:48:57.456995 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36873a6-896e-4549-b225-6dfe94c9edef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41816ff4ec3477d8ebf54ef82115df6, user_id=aba75532be0b4afea1018908ac7111d7, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.457456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73398a99-bad0-4fc2-a6dc-a6f1d098a220 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.459703 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36873a6-896e-4549-b225-6dfe94c9edef admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.474378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73398a99-bad0-4fc2-a6dc-a6f1d098a220 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.479820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 975/1939] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:57 2021] PUT /identity/v3/projects/e41816ff4ec3477d8ebf54ef82115df6/users/aba75532be0b4afea1018908ac7111d7/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:57.483724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36873a6-896e-4549-b225-6dfe94c9edef admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.542703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ea145-0d2d-41d2-aa7f-1ecc4de0490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.543637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea145-0d2d-41d2-aa7f-1ecc4de0490d admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.544095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea145-0d2d-41d2-aa7f-1ecc4de0490d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.544539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9ea145-0d2d-41d2-aa7f-1ecc4de0490d admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.545477 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ea145-0d2d-41d2-aa7f-1ecc4de0490d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.547606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9ea145-0d2d-41d2-aa7f-1ecc4de0490d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.578202 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36873a6-896e-4549-b225-6dfe94c9edef admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.580857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 965/1940] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:57 2021] POST /identity/v3/projects => generated 407 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:57.584240 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668edc2a-b02e-4a2b-b237-42d4bab558e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.584967 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668edc2a-b02e-4a2b-b237-42d4bab558e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.585246 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668edc2a-b02e-4a2b-b237-42d4bab558e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.585345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ea145-0d2d-41d2-aa7f-1ecc4de0490d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.585515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668edc2a-b02e-4a2b-b237-42d4bab558e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.586257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668edc2a-b02e-4a2b-b237-42d4bab558e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.587856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668edc2a-b02e-4a2b-b237-42d4bab558e4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.606027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 976/1941] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:57 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:48:57.606888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668edc2a-b02e-4a2b-b237-42d4bab558e4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.618187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668edc2a-b02e-4a2b-b237-42d4bab558e4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.683823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9ea145-0d2d-41d2-aa7f-1ecc4de0490d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.691336 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63134e-a9b3-476f-8fe2-49bb8902791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.692317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63134e-a9b3-476f-8fe2-49bb8902791b admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.692864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63134e-a9b3-476f-8fe2-49bb8902791b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.693395 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63134e-a9b3-476f-8fe2-49bb8902791b admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.694267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63134e-a9b3-476f-8fe2-49bb8902791b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.696450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63134e-a9b3-476f-8fe2-49bb8902791b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.706667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e452ded-6a3a-4f9d-ab1c-9d794852c151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.707564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e452ded-6a3a-4f9d-ab1c-9d794852c151 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.707842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e452ded-6a3a-4f9d-ab1c-9d794852c151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.708114 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e452ded-6a3a-4f9d-ab1c-9d794852c151 admin admin] PATH_INFO: `/v3/projects/e41816ff4ec3477d8ebf54ef82115df6/users/aba75532be0b4afea1018908ac7111d7/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.710422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e452ded-6a3a-4f9d-ab1c-9d794852c151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41816ff4ec3477d8ebf54ef82115df6, user_id=aba75532be0b4afea1018908ac7111d7, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.714032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e452ded-6a3a-4f9d-ab1c-9d794852c151 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.722348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 966/1942] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:57 2021] POST /identity/v3/users => generated 304 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:57.727442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63134e-a9b3-476f-8fe2-49bb8902791b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.727952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 977/1943] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:57 2021] PUT /identity/v3/projects/e41816ff4ec3477d8ebf54ef82115df6/users/aba75532be0b4afea1018908ac7111d7/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:57.737599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63134e-a9b3-476f-8fe2-49bb8902791b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.742757 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe38ca4-5f29-408e-9dbb-777ff79e7c0a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.743143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe38ca4-5f29-408e-9dbb-777ff79e7c0a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.743434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe38ca4-5f29-408e-9dbb-777ff79e7c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.774485 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-bfe38ca4-5f29-408e-9dbb-777ff79e7c0a None None] MFA Rules not processed for user `aba75532be0b4afea1018908ac7111d7`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:57.775679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bfe38ca4-5f29-408e-9dbb-777ff79e7c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:57.810220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d25a27-2de9-4a02-8e74-55900f05c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.810924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d25a27-2de9-4a02-8e74-55900f05c64d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.811204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d25a27-2de9-4a02-8e74-55900f05c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.811484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d25a27-2de9-4a02-8e74-55900f05c64d admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.812238 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d25a27-2de9-4a02-8e74-55900f05c64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.814074 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d25a27-2de9-4a02-8e74-55900f05c64d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.828322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 967/1944] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:57 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:57.833996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d25a27-2de9-4a02-8e74-55900f05c64d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.849015 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d25a27-2de9-4a02-8e74-55900f05c64d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.855227 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d234a1-29eb-422b-b824-97ed4c5ec50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.855914 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d234a1-29eb-422b-b824-97ed4c5ec50c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.856229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d234a1-29eb-422b-b824-97ed4c5ec50c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.856484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d234a1-29eb-422b-b824-97ed4c5ec50c admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.857271 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d234a1-29eb-422b-b824-97ed4c5ec50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.858892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d234a1-29eb-422b-b824-97ed4c5ec50c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.862725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 978/1945] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:57 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:57.869846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 968/1946] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:57 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:57.874438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe38ca4-5f29-408e-9dbb-777ff79e7c0a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.875536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d234a1-29eb-422b-b824-97ed4c5ec50c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:57.875974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bfe38ca4-5f29-408e-9dbb-777ff79e7c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:57.891569 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d234a1-29eb-422b-b824-97ed4c5ec50c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:57.901123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ad92d-8580-45d4-8765-81451c849963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:57.902349 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ad92d-8580-45d4-8765-81451c849963 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.903395 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ad92d-8580-45d4-8765-81451c849963 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.903395 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ad92d-8580-45d4-8765-81451c849963 admin admin] PATH_INFO: `/v3/projects/57935c2d098c455984aa8b5f87ff29b4/users/4a90ba1ef8f248a083d05f65b1d6f9c0/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.933035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ad92d-8580-45d4-8765-81451c849963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57935c2d098c455984aa8b5f87ff29b4, user_id=4a90ba1ef8f248a083d05f65b1d6f9c0, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:57.933035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ad92d-8580-45d4-8765-81451c849963 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:57.958801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 969/1947] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:57 2021] PUT /identity/v3/projects/57935c2d098c455984aa8b5f87ff29b4/users/4a90ba1ef8f248a083d05f65b1d6f9c0/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:57.969533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e6b2-5ee5-4a1e-b594-037359246f0e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:57.970312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e6b2-5ee5-4a1e-b594-037359246f0e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:57.970682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6e6b2-5ee5-4a1e-b594-037359246f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:57.980346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe38ca4-5f29-408e-9dbb-777ff79e7c0a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:58.018101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-acd6e6b2-5ee5-4a1e-b594-037359246f0e None None] MFA Rules not processed for user `4a90ba1ef8f248a083d05f65b1d6f9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:58.019404 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-acd6e6b2-5ee5-4a1e-b594-037359246f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:58.097067 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4cdbc-b6ff-4257-9fd2-88b0b0289c6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:58.098076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4cdbc-b6ff-4257-9fd2-88b0b0289c6a service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:58.098534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4cdbc-b6ff-4257-9fd2-88b0b0289c6a service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:58.099191 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4cdbc-b6ff-4257-9fd2-88b0b0289c6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:58.198855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 970/1948] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:57 2021] POST /identity/v3/auth/tokens => generated 3274 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:58.206741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6e6b2-5ee5-4a1e-b594-037359246f0e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:58.213371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4cdbc-b6ff-4257-9fd2-88b0b0289c6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:58.216316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b4cdbc-b6ff-4257-9fd2-88b0b0289c6a service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:58.231016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 979/1949] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:57 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:58.290846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4cdbc-b6ff-4257-9fd2-88b0b0289c6a service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:58.300488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6e6b2-5ee5-4a1e-b594-037359246f0e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:58.303487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4cdbc-b6ff-4257-9fd2-88b0b0289c6a service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:58.307251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202fd6-088f-48c1-bdef-7f1148e34ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:58.308038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202fd6-088f-48c1-bdef-7f1148e34ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:58.308325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf821f0e-8b12-4f5f-afc8-f6837a0699fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:58.308563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202fd6-088f-48c1-bdef-7f1148e34ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:58.308721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86202fd6-088f-48c1-bdef-7f1148e34ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:58.309078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf821f0e-8b12-4f5f-afc8-f6837a0699fd service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:58.309427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf821f0e-8b12-4f5f-afc8-f6837a0699fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:58.309697 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202fd6-088f-48c1-bdef-7f1148e34ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:58.309812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf821f0e-8b12-4f5f-afc8-f6837a0699fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:58.311832 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bf821f0e-8b12-4f5f-afc8-f6837a0699fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:58.312143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86202fd6-088f-48c1-bdef-7f1148e34ec0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:58.350839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 971/1950] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:48:58 2021] POST /identity/v3/projects => generated 407 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:48:58.355900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202fd6-088f-48c1-bdef-7f1148e34ec0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:58.414261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf821f0e-8b12-4f5f-afc8-f6837a0699fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:58.416285 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf821f0e-8b12-4f5f-afc8-f6837a0699fd service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:58.426976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 980/1951] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:58 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:48:58.434489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86202fd6-088f-48c1-bdef-7f1148e34ec0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:58.440065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488afce-2455-48b8-beb9-da72fc01ed27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:58.441308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488afce-2455-48b8-beb9-da72fc01ed27 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:58.441308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488afce-2455-48b8-beb9-da72fc01ed27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:58.441680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488afce-2455-48b8-beb9-da72fc01ed27 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:58.442312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488afce-2455-48b8-beb9-da72fc01ed27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:58.444824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488afce-2455-48b8-beb9-da72fc01ed27 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:58.479142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 972/1952] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:48:58 2021] POST /identity/v3/users => generated 310 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:48:58.480484 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf821f0e-8b12-4f5f-afc8-f6837a0699fd service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:58.497385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf821f0e-8b12-4f5f-afc8-f6837a0699fd service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:58.504694 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ab876-23c3-4432-ba07-ce92dc798618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:58.505756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab876-23c3-4432-ba07-ce92dc798618 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:58.506132 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab876-23c3-4432-ba07-ce92dc798618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:58.506415 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ab876-23c3-4432-ba07-ce92dc798618 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:58.507984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ab876-23c3-4432-ba07-ce92dc798618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:58.510885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ab876-23c3-4432-ba07-ce92dc798618 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:58.531758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 981/1953] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:58 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:48:58.534795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488afce-2455-48b8-beb9-da72fc01ed27 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:58.547237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488afce-2455-48b8-beb9-da72fc01ed27 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:58.553816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59969a36-dd3b-4579-9239-ea636a6b08e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:58.554820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59969a36-dd3b-4579-9239-ea636a6b08e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:58.555259 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59969a36-dd3b-4579-9239-ea636a6b08e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:58.555503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59969a36-dd3b-4579-9239-ea636a6b08e2 admin admin] PATH_INFO: `/v3/projects/30eed81f42bd4e899f7d06fe03397e2f/users/d3902667cf924106b7a295efc6e19c9d/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:58.587378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59969a36-dd3b-4579-9239-ea636a6b08e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30eed81f42bd4e899f7d06fe03397e2f, user_id=d3902667cf924106b7a295efc6e19c9d, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:58.591143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59969a36-dd3b-4579-9239-ea636a6b08e2 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:58.609973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 973/1954] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:58 2021] PUT /identity/v3/projects/30eed81f42bd4e899f7d06fe03397e2f/users/d3902667cf924106b7a295efc6e19c9d/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:58.614640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ab876-23c3-4432-ba07-ce92dc798618 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:58.631381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ab876-23c3-4432-ba07-ce92dc798618 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:58.705896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03a6b7-8dc4-48a3-8326-7ec4bbcfe9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:58.706890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03a6b7-8dc4-48a3-8326-7ec4bbcfe9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:58.707232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03a6b7-8dc4-48a3-8326-7ec4bbcfe9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:58.707598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03a6b7-8dc4-48a3-8326-7ec4bbcfe9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:58.708456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03a6b7-8dc4-48a3-8326-7ec4bbcfe9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:58.710201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03a6b7-8dc4-48a3-8326-7ec4bbcfe9a9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:58.721225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 982/1955] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:48:58 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:48:58.727149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59969a36-dd3b-4579-9239-ea636a6b08e2 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:58.738494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59969a36-dd3b-4579-9239-ea636a6b08e2 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:58.743846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978dba-b5bd-4daa-aca4-ffa39050cfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:58.744884 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978dba-b5bd-4daa-aca4-ffa39050cfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:58.745175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978dba-b5bd-4daa-aca4-ffa39050cfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:58.745538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b978dba-b5bd-4daa-aca4-ffa39050cfc8 admin admin] PATH_INFO: `/v3/projects/30eed81f42bd4e899f7d06fe03397e2f/users/d3902667cf924106b7a295efc6e19c9d/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:58.748212 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b978dba-b5bd-4daa-aca4-ffa39050cfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30eed81f42bd4e899f7d06fe03397e2f, user_id=d3902667cf924106b7a295efc6e19c9d, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:58.751215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b978dba-b5bd-4daa-aca4-ffa39050cfc8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:58.766638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 974/1956] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:48:58 2021] PUT /identity/v3/projects/30eed81f42bd4e899f7d06fe03397e2f/users/d3902667cf924106b7a295efc6e19c9d/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:48:58.779093 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79325bd-e67b-4dae-9702-e5ce02530656 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:58.779384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79325bd-e67b-4dae-9702-e5ce02530656 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:58.779670 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79325bd-e67b-4dae-9702-e5ce02530656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:58.810167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b79325bd-e67b-4dae-9702-e5ce02530656 None None] MFA Rules not processed for user `d3902667cf924106b7a295efc6e19c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:48:58.811432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b79325bd-e67b-4dae-9702-e5ce02530656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:48:58.942164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 983/1957] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:48:58 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:48:58.967477 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978dba-b5bd-4daa-aca4-ffa39050cfc8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:59.036097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b978dba-b5bd-4daa-aca4-ffa39050cfc8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:59.040215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730c0a8-f950-4a6e-92e3-a50d6b9cc901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:59.040935 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730c0a8-f950-4a6e-92e3-a50d6b9cc901 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:59.041260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730c0a8-f950-4a6e-92e3-a50d6b9cc901 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:59.041586 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730c0a8-f950-4a6e-92e3-a50d6b9cc901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:59.053738 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730c0a8-f950-4a6e-92e3-a50d6b9cc901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:59.055348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f730c0a8-f950-4a6e-92e3-a50d6b9cc901 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:59.066869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 975/1958] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:58 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:48:59.286706 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79325bd-e67b-4dae-9702-e5ce02530656 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:48:59.302103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79325bd-e67b-4dae-9702-e5ce02530656 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:48:59.309329 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56814883-7e41-421c-89f6-8cd286c36ed6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:48:59.310258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56814883-7e41-421c-89f6-8cd286c36ed6 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:48:59.310723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56814883-7e41-421c-89f6-8cd286c36ed6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:48:59.311131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56814883-7e41-421c-89f6-8cd286c36ed6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:48:59.402959 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56814883-7e41-421c-89f6-8cd286c36ed6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:48:59.404417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56814883-7e41-421c-89f6-8cd286c36ed6 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:48:59.415753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 984/1959] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:48:59 2021] GET /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:06.271012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730c0a8-f950-4a6e-92e3-a50d6b9cc901 service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:06.272886 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f730c0a8-f950-4a6e-92e3-a50d6b9cc901 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:06.454424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730c0a8-f950-4a6e-92e3-a50d6b9cc901 service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:06.466208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:06.467592 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:06.468064 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:06.468527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] PATH_INFO: `/v3/users/53a664d15d8048a8a871bfeb4bf8bc0f` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:06.470376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a664d15d8048a8a871bfeb4bf8bc0f)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:06.474223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:06.561015 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a664d15d8048a8a871bfeb4bf8bc0f'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:06.587053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a664d15d8048a8a871bfeb4bf8bc0f'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:06.597188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a664d15d8048a8a871bfeb4bf8bc0f'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:06.606736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a664d15d8048a8a871bfeb4bf8bc0f'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:06.613908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a664d15d8048a8a871bfeb4bf8bc0f'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:06.624111 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 976/1960] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:06 2021] DELETE /identity/v3/users/53a664d15d8048a8a871bfeb4bf8bc0f => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:06.631930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75c964-2f6f-4eed-a249-4174da3c7522 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:06.633017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75c964-2f6f-4eed-a249-4174da3c7522 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:06.633493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc75c964-2f6f-4eed-a249-4174da3c7522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:06.660618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-bc75c964-2f6f-4eed-a249-4174da3c7522 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:06.661914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bc75c964-2f6f-4eed-a249-4174da3c7522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:06.761559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 985/1961] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:06.772960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:06.775893 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:06.880372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be324999-ae3f-4abd-a147-21a68f293285 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:06.886229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496267d7-ba15-4f9b-a07e-d2583e3f74f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:06.886898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496267d7-ba15-4f9b-a07e-d2583e3f74f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:06.887361 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496267d7-ba15-4f9b-a07e-d2583e3f74f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:06.887817 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496267d7-ba15-4f9b-a07e-d2583e3f74f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:06.900828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496267d7-ba15-4f9b-a07e-d2583e3f74f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:06.903164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496267d7-ba15-4f9b-a07e-d2583e3f74f3 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:06.914577 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 977/1962] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:07.058902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75c964-2f6f-4eed-a249-4174da3c7522 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:07.060420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bc75c964-2f6f-4eed-a249-4174da3c7522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:07.086467 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc75c964-2f6f-4eed-a249-4174da3c7522 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:07.092236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:07.093621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:07.093902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:07.094175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] PATH_INFO: `/v3/users/b4418b7ab10b434198311db6b8f7853e` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:07.095708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4418b7ab10b434198311db6b8f7853e)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:07.098278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:07.152255 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4418b7ab10b434198311db6b8f7853e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.164233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4418b7ab10b434198311db6b8f7853e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.165066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4418b7ab10b434198311db6b8f7853e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.173421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4418b7ab10b434198311db6b8f7853e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.183934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4418b7ab10b434198311db6b8f7853e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.190855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 986/1963] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:07 2021] DELETE /identity/v3/users/b4418b7ab10b434198311db6b8f7853e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:07.196065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5759b9-5c16-4142-9f19-32fb75a5f12e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:07.196392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5759b9-5c16-4142-9f19-32fb75a5f12e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:07.197085 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5759b9-5c16-4142-9f19-32fb75a5f12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:07.216954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-6e5759b9-5c16-4142-9f19-32fb75a5f12e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:07.218191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6e5759b9-5c16-4142-9f19-32fb75a5f12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:07.225166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:07.227737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:07.292877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 978/1964] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:07.304401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5759b9-5c16-4142-9f19-32fb75a5f12e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:07.306045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6e5759b9-5c16-4142-9f19-32fb75a5f12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:07.313588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123532a1-e7c7-4518-9de7-237cd5a151b6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:07.325061 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:07.325958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:07.326233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:07.326684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] PATH_INFO: `/v3/projects/f5b025dfc2c848d7aef6e0103fe67271` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:07.327960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b025dfc2c848d7aef6e0103fe67271)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:07.330677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:07.389361 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b025dfc2c848d7aef6e0103fe67271', 'request_id': 'req-a298568c-2b49-4758-ad8c-87f296c9819f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.393618 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5759b9-5c16-4142-9f19-32fb75a5f12e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:07.399784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b025dfc2c848d7aef6e0103fe67271', 'request_id': 'req-a298568c-2b49-4758-ad8c-87f296c9819f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.410379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b025dfc2c848d7aef6e0103fe67271', 'request_id': 'req-a298568c-2b49-4758-ad8c-87f296c9819f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.426270 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] The token cache is being invalidate because project f5b025dfc2c848d7aef6e0103fe67271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:07.426566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.429048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.439056 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 987/1965] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:07 2021] DELETE /identity/v3/projects/f5b025dfc2c848d7aef6e0103fe67271 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:07.449215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:07.451529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:07.472019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed6e7a-4c5e-42ab-aafd-b5fbf75e17db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:07.472937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed6e7a-4c5e-42ab-aafd-b5fbf75e17db service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:07.473255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed6e7a-4c5e-42ab-aafd-b5fbf75e17db service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:07.473530 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed6e7a-4c5e-42ab-aafd-b5fbf75e17db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:07.476155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-50ed6e7a-4c5e-42ab-aafd-b5fbf75e17db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:07.542903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298568c-2b49-4758-ad8c-87f296c9819f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:07.548437 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:07.549603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:07.549981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:07.550162 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] PATH_INFO: `/v3/users/25b89887a34e4759a060088604b040ec` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:07.551722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed6e7a-4c5e-42ab-aafd-b5fbf75e17db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:07.552280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=25b89887a34e4759a060088604b040ec)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:07.553316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed6e7a-4c5e-42ab-aafd-b5fbf75e17db service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:07.554305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:07.564820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 979/1966] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:07.614898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25b89887a34e4759a060088604b040ec'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.638982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25b89887a34e4759a060088604b040ec'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.640900 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25b89887a34e4759a060088604b040ec'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.651445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25b89887a34e4759a060088604b040ec'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.660621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25b89887a34e4759a060088604b040ec'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:07.668377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 988/1967] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:07 2021] DELETE /identity/v3/users/25b89887a34e4759a060088604b040ec => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:07.986852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed6e7a-4c5e-42ab-aafd-b5fbf75e17db service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:07.989209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-50ed6e7a-4c5e-42ab-aafd-b5fbf75e17db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:08.012783 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed6e7a-4c5e-42ab-aafd-b5fbf75e17db service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:08.095195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:08.096897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:08.108103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:08.109141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.109496 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.109902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] PATH_INFO: `/v3/projects/6634e5fc5b134c7ebba735a6b13c3c6c` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.111624 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] RBAC: Authorizing `identity:delete_project(project_id=6634e5fc5b134c7ebba735a6b13c3c6c)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:08.114369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:08.187979 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6634e5fc5b134c7ebba735a6b13c3c6c', 'request_id': 'req-b6b59242-c2c9-45c6-9bea-7360ff0af7de'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.188249 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8491c959-4b82-4322-a1ad-78e128760a2f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:08.197293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6634e5fc5b134c7ebba735a6b13c3c6c', 'request_id': 'req-b6b59242-c2c9-45c6-9bea-7360ff0af7de'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.204838 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6634e5fc5b134c7ebba735a6b13c3c6c', 'request_id': 'req-b6b59242-c2c9-45c6-9bea-7360ff0af7de'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.217062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] The token cache is being invalidate because project 6634e5fc5b134c7ebba735a6b13c3c6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:08.217347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.218035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.219841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 980/1968] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:07 2021] DELETE /identity/v3/projects/6634e5fc5b134c7ebba735a6b13c3c6c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:08.224832 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:08.227618 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:08.254893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:08.255773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.256224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.256507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] PATH_INFO: `/v3/projects/91dc3553edda40aab377c16ef79b1dd9` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.258047 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=91dc3553edda40aab377c16ef79b1dd9)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:08.260021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:08.301101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b59242-c2c9-45c6-9bea-7360ff0af7de admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:08.315181 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91dc3553edda40aab377c16ef79b1dd9', 'request_id': 'req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.325090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91dc3553edda40aab377c16ef79b1dd9', 'request_id': 'req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.333581 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91dc3553edda40aab377c16ef79b1dd9', 'request_id': 'req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.345242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] The token cache is being invalidate because project 91dc3553edda40aab377c16ef79b1dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:08.345611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.346496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9291e104-9ede-4ccc-a3ff-7ebec3a9b8fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.348745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 989/1969] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:08 2021] DELETE /identity/v3/projects/91dc3553edda40aab377c16ef79b1dd9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:08.354465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaefc6-67a5-433e-8ee0-a3aef9a934f3 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.354920 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaefc6-67a5-433e-8ee0-a3aef9a934f3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.355055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aaefc6-67a5-433e-8ee0-a3aef9a934f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.368034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:08.369147 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.369591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.370145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] PATH_INFO: `/v3/users/f5a62c8406564580988c9f02ca62276c` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.372152 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a62c8406564580988c9f02ca62276c)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:08.374774 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:08.379012 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-73aaefc6-67a5-433e-8ee0-a3aef9a934f3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:08.380410 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-73aaefc6-67a5-433e-8ee0-a3aef9a934f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:08.390499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 990/1970] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:08.399180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810fd8-1edd-4224-aa05-91fc2c44a74e None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.407978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810fd8-1edd-4224-aa05-91fc2c44a74e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.407978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee810fd8-1edd-4224-aa05-91fc2c44a74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.424373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-ee810fd8-1edd-4224-aa05-91fc2c44a74e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:08.424373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ee810fd8-1edd-4224-aa05-91fc2c44a74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:08.434171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 991/1971] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:08.438461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810fd8-1edd-4224-aa05-91fc2c44a74e None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:08.452774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee810fd8-1edd-4224-aa05-91fc2c44a74e None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:08.460902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a62c8406564580988c9f02ca62276c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.466617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf597f-a6ac-4611-ad3e-7b7baf7914a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:08.468543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf597f-a6ac-4611-ad3e-7b7baf7914a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.470679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf597f-a6ac-4611-ad3e-7b7baf7914a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.473111 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf597f-a6ac-4611-ad3e-7b7baf7914a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.474101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf597f-a6ac-4611-ad3e-7b7baf7914a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:08.476226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf597f-a6ac-4611-ad3e-7b7baf7914a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:08.480367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a62c8406564580988c9f02ca62276c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.480562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf597f-a6ac-4611-ad3e-7b7baf7914a6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:08.492243 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a62c8406564580988c9f02ca62276c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.498713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 992/1972] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:49:08.503448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf597f-a6ac-4611-ad3e-7b7baf7914a6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:08.507516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a62c8406564580988c9f02ca62276c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.508635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a62c8406564580988c9f02ca62276c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.516856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf597f-a6ac-4611-ad3e-7b7baf7914a6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:08.517565 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 981/1973] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:08 2021] DELETE /identity/v3/users/f5a62c8406564580988c9f02ca62276c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:08.592720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fedf1-b936-4c59-9885-783dbbff692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:08.593400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fedf1-b936-4c59-9885-783dbbff692a admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.593683 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fedf1-b936-4c59-9885-783dbbff692a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.593956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fedf1-b936-4c59-9885-783dbbff692a admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.594669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fedf1-b936-4c59-9885-783dbbff692a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:08.596697 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fedf1-b936-4c59-9885-783dbbff692a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:08.628501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 993/1974] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:08 2021] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:08.633345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:08.634779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:08.647700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48bfcd-1838-4a7e-bcc6-54a239e10660 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:08.708725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a25f0-85ed-4275-a422-43748fd9450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:08.709449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a25f0-85ed-4275-a422-43748fd9450b admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.709734 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a25f0-85ed-4275-a422-43748fd9450b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.710010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a25f0-85ed-4275-a422-43748fd9450b admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.710823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a25f0-85ed-4275-a422-43748fd9450b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:08.712689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a25f0-85ed-4275-a422-43748fd9450b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:08.737571 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 982/1975] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:08 2021] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:08.741799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fedf1-b936-4c59-9885-783dbbff692a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:08.753420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fedf1-b936-4c59-9885-783dbbff692a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:08.758919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543e1e9-0b95-4d60-9a30-1c619916081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:08.759685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543e1e9-0b95-4d60-9a30-1c619916081c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.760106 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543e1e9-0b95-4d60-9a30-1c619916081c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.760384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543e1e9-0b95-4d60-9a30-1c619916081c admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.761185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543e1e9-0b95-4d60-9a30-1c619916081c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:08.762803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543e1e9-0b95-4d60-9a30-1c619916081c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:08.774270 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 994/1976] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:08 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:08.778612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a25f0-85ed-4275-a422-43748fd9450b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:08.791884 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a25f0-85ed-4275-a422-43748fd9450b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:08.797302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff108bf9-0958-44e6-a8bf-92f17c3fef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:08.797997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff108bf9-0958-44e6-a8bf-92f17c3fef08 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.798390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff108bf9-0958-44e6-a8bf-92f17c3fef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.798669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff108bf9-0958-44e6-a8bf-92f17c3fef08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.799408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff108bf9-0958-44e6-a8bf-92f17c3fef08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:08.801280 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff108bf9-0958-44e6-a8bf-92f17c3fef08 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:08.805008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543e1e9-0b95-4d60-9a30-1c619916081c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:08.806883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b543e1e9-0b95-4d60-9a30-1c619916081c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:08.817739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 983/1977] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:08 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:08.821186 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543e1e9-0b95-4d60-9a30-1c619916081c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:08.821991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff108bf9-0958-44e6-a8bf-92f17c3fef08 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:08.832131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:08.833083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.833365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.833639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] PATH_INFO: `/v3/projects/f1b4effb62c047c38a91772bc253ce75` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.833961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff108bf9-0958-44e6-a8bf-92f17c3fef08 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:08.835003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b4effb62c047c38a91772bc253ce75)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:08.837062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:08.838522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60446062-8668-4f2e-b4ae-9da326d61d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:08.839418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60446062-8668-4f2e-b4ae-9da326d61d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.839839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60446062-8668-4f2e-b4ae-9da326d61d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.840123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60446062-8668-4f2e-b4ae-9da326d61d34 admin admin] PATH_INFO: `/v3/projects/91c5762027a4404291fc061064a693ec/users/5e76341778fa4af9bad9305c5dee1f7c/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.857599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60446062-8668-4f2e-b4ae-9da326d61d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91c5762027a4404291fc061064a693ec, user_id=5e76341778fa4af9bad9305c5dee1f7c, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:08.860387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60446062-8668-4f2e-b4ae-9da326d61d34 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:08.877266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 984/1978] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:08 2021] PUT /identity/v3/projects/91c5762027a4404291fc061064a693ec/users/5e76341778fa4af9bad9305c5dee1f7c/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:08.886471 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b4effb62c047c38a91772bc253ce75', 'request_id': 'req-256c3789-e853-44b6-9022-57c4c00c2d67'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.888605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ecfb9-f8c9-488a-8f99-6213c0aa3bce None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:08.888889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ecfb9-f8c9-488a-8f99-6213c0aa3bce None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:08.889202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ecfb9-f8c9-488a-8f99-6213c0aa3bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:08.895290 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b4effb62c047c38a91772bc253ce75', 'request_id': 'req-256c3789-e853-44b6-9022-57c4c00c2d67'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.902220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b4effb62c047c38a91772bc253ce75', 'request_id': 'req-256c3789-e853-44b6-9022-57c4c00c2d67'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.913207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] The token cache is being invalidate because project f1b4effb62c047c38a91772bc253ce75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:08.913490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.914157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:08.916915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 995/1979] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:08 2021] DELETE /identity/v3/projects/f1b4effb62c047c38a91772bc253ce75 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:08.920086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-a32ecfb9-f8c9-488a-8f99-6213c0aa3bce None None] MFA Rules not processed for user `5e76341778fa4af9bad9305c5dee1f7c`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:08.920488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a32ecfb9-f8c9-488a-8f99-6213c0aa3bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:08.921397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:08.922810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:08.991673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 985/1980] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:08 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:08.993595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c3789-e853-44b6-9022-57c4c00c2d67 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:08.994122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ecfb9-f8c9-488a-8f99-6213c0aa3bce None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:08.996114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a32ecfb9-f8c9-488a-8f99-6213c0aa3bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:08.998818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:08.999833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.000123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.000399 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] PATH_INFO: `/v3/users/aba75532be0b4afea1018908ac7111d7` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.001674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba75532be0b4afea1018908ac7111d7)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.003663 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.013331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ecfb9-f8c9-488a-8f99-6213c0aa3bce None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:09.020923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f239e-301f-4573-b08e-04828225fcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:09.021226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f239e-301f-4573-b08e-04828225fcea admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.021467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f239e-301f-4573-b08e-04828225fcea admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.021737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f239e-301f-4573-b08e-04828225fcea admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.022598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f239e-301f-4573-b08e-04828225fcea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.024770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f239e-301f-4573-b08e-04828225fcea admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.062330 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba75532be0b4afea1018908ac7111d7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:09.062495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 986/1981] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:08 2021] POST /identity/v3/projects => generated 387 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:09.067023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f239e-301f-4573-b08e-04828225fcea admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.077449 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba75532be0b4afea1018908ac7111d7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:09.078329 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba75532be0b4afea1018908ac7111d7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:09.085969 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba75532be0b4afea1018908ac7111d7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:09.100976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba75532be0b4afea1018908ac7111d7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:09.118764 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 996/1982] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:08 2021] DELETE /identity/v3/users/aba75532be0b4afea1018908ac7111d7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:09.155422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f239e-301f-4573-b08e-04828225fcea admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:09.241786 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f793f-8479-480f-9bd9-172fb5dc2189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:09.243086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f793f-8479-480f-9bd9-172fb5dc2189 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.243381 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f793f-8479-480f-9bd9-172fb5dc2189 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.243701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f793f-8479-480f-9bd9-172fb5dc2189 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.244414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f793f-8479-480f-9bd9-172fb5dc2189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.248063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f793f-8479-480f-9bd9-172fb5dc2189 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.275626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 987/1983] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:09 2021] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:09.280306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.282001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:09.300024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0675-99bc-4143-a1bd-386a8cc39ef7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:09.304164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd598969-a001-4b95-84a8-da291a6ed724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:09.305212 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd598969-a001-4b95-84a8-da291a6ed724 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.305707 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd598969-a001-4b95-84a8-da291a6ed724 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.306015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd598969-a001-4b95-84a8-da291a6ed724 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.306812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd598969-a001-4b95-84a8-da291a6ed724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.308731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd598969-a001-4b95-84a8-da291a6ed724 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.327595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 997/1984] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:09 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:09.342041 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f793f-8479-480f-9bd9-172fb5dc2189 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.357484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f793f-8479-480f-9bd9-172fb5dc2189 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:09.366184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10d337-fe45-4536-be90-a6b904d3084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:09.367491 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10d337-fe45-4536-be90-a6b904d3084b admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.367828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10d337-fe45-4536-be90-a6b904d3084b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.368371 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10d337-fe45-4536-be90-a6b904d3084b admin admin] PATH_INFO: `/v3/projects/a4610905e90243788775b392ebcf446c/users/cc3cab699e0545d88671fa6a7281087f/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.392672 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10d337-fe45-4536-be90-a6b904d3084b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4610905e90243788775b392ebcf446c, user_id=cc3cab699e0545d88671fa6a7281087f, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.396081 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10d337-fe45-4536-be90-a6b904d3084b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.414348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 988/1985] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:09 2021] PUT /identity/v3/projects/a4610905e90243788775b392ebcf446c/users/cc3cab699e0545d88671fa6a7281087f/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:09.418785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd598969-a001-4b95-84a8-da291a6ed724 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.430351 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd598969-a001-4b95-84a8-da291a6ed724 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:09.499886 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc1bb9-4bb7-4c8a-a5e4-b9551b7903ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:09.500695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1bb9-4bb7-4c8a-a5e4-b9551b7903ba admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.500984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1bb9-4bb7-4c8a-a5e4-b9551b7903ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.501254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc1bb9-4bb7-4c8a-a5e4-b9551b7903ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.502005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc1bb9-4bb7-4c8a-a5e4-b9551b7903ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.503919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc1bb9-4bb7-4c8a-a5e4-b9551b7903ba admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.513839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10d337-fe45-4536-be90-a6b904d3084b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.514410 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 998/1986] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:09 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:09.515994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1d10d337-fe45-4536-be90-a6b904d3084b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:09.520345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc1bb9-4bb7-4c8a-a5e4-b9551b7903ba admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.533348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10d337-fe45-4536-be90-a6b904d3084b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:09.535001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc1bb9-4bb7-4c8a-a5e4-b9551b7903ba admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:09.542854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:09.544011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.544450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.545116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] PATH_INFO: `/v3/projects/e41816ff4ec3477d8ebf54ef82115df6` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.545598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b016d-82fe-4fa6-9271-6db402e315e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:09.546511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b016d-82fe-4fa6-9271-6db402e315e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.546791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b016d-82fe-4fa6-9271-6db402e315e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.547092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b016d-82fe-4fa6-9271-6db402e315e7 admin admin] PATH_INFO: `/v3/projects/a4610905e90243788775b392ebcf446c/users/cc3cab699e0545d88671fa6a7281087f/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.547399 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41816ff4ec3477d8ebf54ef82115df6)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.549265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b016d-82fe-4fa6-9271-6db402e315e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4610905e90243788775b392ebcf446c, user_id=cc3cab699e0545d88671fa6a7281087f, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.551493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.553024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b016d-82fe-4fa6-9271-6db402e315e7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.573417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 999/1987] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:09 2021] PUT /identity/v3/projects/a4610905e90243788775b392ebcf446c/users/cc3cab699e0545d88671fa6a7281087f/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:09.576170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4efa43-25a9-4238-a702-c258ccc38e22 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.576667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4efa43-25a9-4238-a702-c258ccc38e22 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.576889 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4efa43-25a9-4238-a702-c258ccc38e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.611217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-fb4efa43-25a9-4238-a702-c258ccc38e22 None None] MFA Rules not processed for user `cc3cab699e0545d88671fa6a7281087f`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:09.612503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fb4efa43-25a9-4238-a702-c258ccc38e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:09.617506 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41816ff4ec3477d8ebf54ef82115df6', 'request_id': 'req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:09.627123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41816ff4ec3477d8ebf54ef82115df6', 'request_id': 'req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:09.634938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41816ff4ec3477d8ebf54ef82115df6', 'request_id': 'req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:09.646011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] The token cache is being invalidate because project e41816ff4ec3477d8ebf54ef82115df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:09.646303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:09.646976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c4102aa2-0524-477d-80f3-17ce8dbbcfcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:09.648604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 989/1988] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:09 2021] DELETE /identity/v3/projects/e41816ff4ec3477d8ebf54ef82115df6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:09.655331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efa4e-5773-4841-9ef7-fabbaa884a0b None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.656180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efa4e-5773-4841-9ef7-fabbaa884a0b None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.656519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68efa4e-5773-4841-9ef7-fabbaa884a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.676246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f68efa4e-5773-4841-9ef7-fabbaa884a0b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:09.677496 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f68efa4e-5773-4841-9ef7-fabbaa884a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:09.694431 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1000/1989] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:09 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:09.701450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4efa43-25a9-4238-a702-c258ccc38e22 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.703018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fb4efa43-25a9-4238-a702-c258ccc38e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:09.751485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 990/1990] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:09.760704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a6364-060f-4161-8a8d-b3124d7cbeaa None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.761090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a6364-060f-4161-8a8d-b3124d7cbeaa None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.761447 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a6364-060f-4161-8a8d-b3124d7cbeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.764524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4efa43-25a9-4238-a702-c258ccc38e22 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:09.768208 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bd369-907d-48e7-ad33-0cc4c491224e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:09.769171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bd369-907d-48e7-ad33-0cc4c491224e service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.769709 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bd369-907d-48e7-ad33-0cc4c491224e service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.770031 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82bd369-907d-48e7-ad33-0cc4c491224e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.781372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-156a6364-060f-4161-8a8d-b3124d7cbeaa None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:09.782624 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-156a6364-060f-4161-8a8d-b3124d7cbeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:09.786397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bd369-907d-48e7-ad33-0cc4c491224e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.789535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82bd369-907d-48e7-ad33-0cc4c491224e service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.791362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 991/1991] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:09.795634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a6364-060f-4161-8a8d-b3124d7cbeaa None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.801223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1001/1992] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:09 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:09.804840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a6364-060f-4161-8a8d-b3124d7cbeaa None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:09.809802 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9132c-9a30-4205-ac9c-ec83769a45f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:09.810468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9132c-9a30-4205-ac9c-ec83769a45f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.811107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9132c-9a30-4205-ac9c-ec83769a45f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.811107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9132c-9a30-4205-ac9c-ec83769a45f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.811766 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9132c-9a30-4205-ac9c-ec83769a45f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:09.812069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9132c-9a30-4205-ac9c-ec83769a45f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.813683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9132c-9a30-4205-ac9c-ec83769a45f8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.825596 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 992/1993] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:49:09.829693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bd369-907d-48e7-ad33-0cc4c491224e service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.841624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82bd369-907d-48e7-ad33-0cc4c491224e service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:09.846207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914525b-f774-4c35-ac73-d50e0a0e9a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:09.846897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914525b-f774-4c35-ac73-d50e0a0e9a57 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.847179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914525b-f774-4c35-ac73-d50e0a0e9a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.847454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914525b-f774-4c35-ac73-d50e0a0e9a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.848164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914525b-f774-4c35-ac73-d50e0a0e9a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.850222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914525b-f774-4c35-ac73-d50e0a0e9a57 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.881996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1002/1994] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:09 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:09.883095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9132c-9a30-4205-ac9c-ec83769a45f8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.894719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9132c-9a30-4205-ac9c-ec83769a45f8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:09.927713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914525b-f774-4c35-ac73-d50e0a0e9a57 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.929514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e914525b-f774-4c35-ac73-d50e0a0e9a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:09.956169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae6b2-e1c5-407c-9fa4-01f87a852f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:09.957085 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae6b2-e1c5-407c-9fa4-01f87a852f04 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:09.957369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae6b2-e1c5-407c-9fa4-01f87a852f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:09.957642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae6b2-e1c5-407c-9fa4-01f87a852f04 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:09.958382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfae6b2-e1c5-407c-9fa4-01f87a852f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:09.960287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfae6b2-e1c5-407c-9fa4-01f87a852f04 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:09.987357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 993/1995] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:09 2021] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:09.990895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae6b2-e1c5-407c-9fa4-01f87a852f04 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:09.998238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914525b-f774-4c35-ac73-d50e0a0e9a57 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.003075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae6b2-e1c5-407c-9fa4-01f87a852f04 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.007932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3deb93b-67f1-41d2-9e19-689d71cd8dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.008993 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3deb93b-67f1-41d2-9e19-689d71cd8dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.009334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3deb93b-67f1-41d2-9e19-689d71cd8dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.009744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3deb93b-67f1-41d2-9e19-689d71cd8dfd admin admin] PATH_INFO: `/v3/users/5e76341778fa4af9bad9305c5dee1f7c` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.010393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c8297-e45f-4a92-91e3-2b8fc466c907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.011085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3deb93b-67f1-41d2-9e19-689d71cd8dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e76341778fa4af9bad9305c5dee1f7c)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.011199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c8297-e45f-4a92-91e3-2b8fc466c907 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.011518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c8297-e45f-4a92-91e3-2b8fc466c907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.011913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301c8297-e45f-4a92-91e3-2b8fc466c907 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.012892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c8297-e45f-4a92-91e3-2b8fc466c907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.013406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3deb93b-67f1-41d2-9e19-689d71cd8dfd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.014678 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301c8297-e45f-4a92-91e3-2b8fc466c907 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.026172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 994/1996] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:09 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:10.034444 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c8297-e45f-4a92-91e3-2b8fc466c907 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:10.047099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301c8297-e45f-4a92-91e3-2b8fc466c907 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.055398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73063bd1-795e-4e85-824c-edef1b1121f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.056091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73063bd1-795e-4e85-824c-edef1b1121f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.056390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73063bd1-795e-4e85-824c-edef1b1121f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.056861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73063bd1-795e-4e85-824c-edef1b1121f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.057608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73063bd1-795e-4e85-824c-edef1b1121f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.059237 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73063bd1-795e-4e85-824c-edef1b1121f9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.074043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 995/1997] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:10 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:10.078623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73063bd1-795e-4e85-824c-edef1b1121f9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:10.085184 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f3deb93b-67f1-41d2-9e19-689d71cd8dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e76341778fa4af9bad9305c5dee1f7c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:10.090813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73063bd1-795e-4e85-824c-edef1b1121f9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.096025 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e05bec-1311-4d91-a53d-e732574bec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.097427 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e05bec-1311-4d91-a53d-e732574bec95 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.097969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e05bec-1311-4d91-a53d-e732574bec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.098357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e05bec-1311-4d91-a53d-e732574bec95 admin admin] PATH_INFO: `/v3/projects/e40e38250ecc457090926506acc084cd/users/803c11057e1f46c68b2880064caa059f/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.099024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f3deb93b-67f1-41d2-9e19-689d71cd8dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e76341778fa4af9bad9305c5dee1f7c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:10.100125 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f3deb93b-67f1-41d2-9e19-689d71cd8dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e76341778fa4af9bad9305c5dee1f7c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:10.109586 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f3deb93b-67f1-41d2-9e19-689d71cd8dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e76341778fa4af9bad9305c5dee1f7c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:10.117043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e05bec-1311-4d91-a53d-e732574bec95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40e38250ecc457090926506acc084cd, user_id=803c11057e1f46c68b2880064caa059f, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.118661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f3deb93b-67f1-41d2-9e19-689d71cd8dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e76341778fa4af9bad9305c5dee1f7c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:10.120269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e05bec-1311-4d91-a53d-e732574bec95 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.127034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1003/1998] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:09 2021] DELETE /identity/v3/users/5e76341778fa4af9bad9305c5dee1f7c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:10.136381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a70a2-672a-4c92-8522-209924e4f746 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.136803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a70a2-672a-4c92-8522-209924e4f746 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.137074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a70a2-672a-4c92-8522-209924e4f746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.142977 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 996/1999] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:10 2021] PUT /identity/v3/projects/e40e38250ecc457090926506acc084cd/users/803c11057e1f46c68b2880064caa059f/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:10.156296 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b725-5a06-48bd-aae1-c8efbecf2615 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.156941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b725-5a06-48bd-aae1-c8efbecf2615 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.157378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428b725-5a06-48bd-aae1-c8efbecf2615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.172672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c16a70a2-672a-4c92-8522-209924e4f746 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:10.173897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c16a70a2-672a-4c92-8522-209924e4f746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:10.222915 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c428b725-5a06-48bd-aae1-c8efbecf2615 None None] MFA Rules not processed for user `803c11057e1f46c68b2880064caa059f`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:10.227157 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c428b725-5a06-48bd-aae1-c8efbecf2615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:10.249649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1004/2000] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:10.261915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a70a2-672a-4c92-8522-209924e4f746 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:10.263608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c16a70a2-672a-4c92-8522-209924e4f746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:10.313742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 997/2001] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:10 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:10.321502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b725-5a06-48bd-aae1-c8efbecf2615 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:10.323094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c428b725-5a06-48bd-aae1-c8efbecf2615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:10.341215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428b725-5a06-48bd-aae1-c8efbecf2615 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.347042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233afff-f6e6-47e5-9d27-cad063f2c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.348616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233afff-f6e6-47e5-9d27-cad063f2c85f admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.348994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233afff-f6e6-47e5-9d27-cad063f2c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.349360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233afff-f6e6-47e5-9d27-cad063f2c85f admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.350422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233afff-f6e6-47e5-9d27-cad063f2c85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.353233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233afff-f6e6-47e5-9d27-cad063f2c85f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.364017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a70a2-672a-4c92-8522-209924e4f746 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.370732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764c3a5-e056-4dc3-b5fa-c23640fbd397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.371458 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764c3a5-e056-4dc3-b5fa-c23640fbd397 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.372450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764c3a5-e056-4dc3-b5fa-c23640fbd397 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.372851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764c3a5-e056-4dc3-b5fa-c23640fbd397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.384558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764c3a5-e056-4dc3-b5fa-c23640fbd397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.386159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764c3a5-e056-4dc3-b5fa-c23640fbd397 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.390609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 998/2002] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:10 2021] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:10.396020 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233afff-f6e6-47e5-9d27-cad063f2c85f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:10.398670 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1005/2003] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:10.467293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233afff-f6e6-47e5-9d27-cad063f2c85f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.473153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750c3dc-ace2-47f2-b8bb-ef2be2788b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.473860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750c3dc-ace2-47f2-b8bb-ef2be2788b44 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.474220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750c3dc-ace2-47f2-b8bb-ef2be2788b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.474834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750c3dc-ace2-47f2-b8bb-ef2be2788b44 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.475708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750c3dc-ace2-47f2-b8bb-ef2be2788b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.477713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750c3dc-ace2-47f2-b8bb-ef2be2788b44 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.499208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 999/2004] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:10 2021] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:10.503706 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764c3a5-e056-4dc3-b5fa-c23640fbd397 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:10.513702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764c3a5-e056-4dc3-b5fa-c23640fbd397 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.518539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97560636-7055-4a93-8ce9-5a64612ced50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.519480 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97560636-7055-4a93-8ce9-5a64612ced50 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.519819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97560636-7055-4a93-8ce9-5a64612ced50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.520245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97560636-7055-4a93-8ce9-5a64612ced50 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.521177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97560636-7055-4a93-8ce9-5a64612ced50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.522902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97560636-7055-4a93-8ce9-5a64612ced50 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.534618 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1006/2005] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:10.546750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750c3dc-ace2-47f2-b8bb-ef2be2788b44 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:10.557434 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750c3dc-ace2-47f2-b8bb-ef2be2788b44 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.561985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033ccb6-3805-4454-a95f-cfd6f02bde2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.563301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ccb6-3805-4454-a95f-cfd6f02bde2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.563582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ccb6-3805-4454-a95f-cfd6f02bde2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.563851 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033ccb6-3805-4454-a95f-cfd6f02bde2e admin admin] PATH_INFO: `/v3/projects/a358501c0c6f41d8a3f372ab8a051d73/users/fbd9a006440943f786254fdacc7de29d/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.595899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033ccb6-3805-4454-a95f-cfd6f02bde2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a358501c0c6f41d8a3f372ab8a051d73, user_id=fbd9a006440943f786254fdacc7de29d, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.598852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033ccb6-3805-4454-a95f-cfd6f02bde2e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.616290 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1000/2006] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:10 2021] PUT /identity/v3/projects/a358501c0c6f41d8a3f372ab8a051d73/users/fbd9a006440943f786254fdacc7de29d/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:10.620058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97560636-7055-4a93-8ce9-5a64612ced50 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:10.640972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97560636-7055-4a93-8ce9-5a64612ced50 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.736054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8b4c6-1aba-4d31-a924-2d9e3ca2de88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.736815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8b4c6-1aba-4d31-a924-2d9e3ca2de88 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.737363 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8b4c6-1aba-4d31-a924-2d9e3ca2de88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.737778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8b4c6-1aba-4d31-a924-2d9e3ca2de88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.738695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8b4c6-1aba-4d31-a924-2d9e3ca2de88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.740273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8b4c6-1aba-4d31-a924-2d9e3ca2de88 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.752867 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1007/2007] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:10 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:10.757146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033ccb6-3805-4454-a95f-cfd6f02bde2e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:10.768251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033ccb6-3805-4454-a95f-cfd6f02bde2e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.775301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29a348-9290-4fa5-80dd-8c88f7f048a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.776308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29a348-9290-4fa5-80dd-8c88f7f048a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.776777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29a348-9290-4fa5-80dd-8c88f7f048a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.777052 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29a348-9290-4fa5-80dd-8c88f7f048a1 admin admin] PATH_INFO: `/v3/projects/a358501c0c6f41d8a3f372ab8a051d73/users/fbd9a006440943f786254fdacc7de29d/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.779332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29a348-9290-4fa5-80dd-8c88f7f048a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a358501c0c6f41d8a3f372ab8a051d73, user_id=fbd9a006440943f786254fdacc7de29d, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.782251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29a348-9290-4fa5-80dd-8c88f7f048a1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.792200 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8b4c6-1aba-4d31-a924-2d9e3ca2de88 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:10.793972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cbb8b4c6-1aba-4d31-a924-2d9e3ca2de88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:10.801613 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1001/2008] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:10 2021] PUT /identity/v3/projects/a358501c0c6f41d8a3f372ab8a051d73/users/fbd9a006440943f786254fdacc7de29d/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:10.807461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8b4c6-1aba-4d31-a924-2d9e3ca2de88 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:10.812482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4dbb-2c1f-4e81-947b-c761d6475501 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.812805 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4dbb-2c1f-4e81-947b-c761d6475501 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.813088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c4dbb-2c1f-4e81-947b-c761d6475501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.846868 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d38c4dbb-2c1f-4e81-947b-c761d6475501 None None] MFA Rules not processed for user `fbd9a006440943f786254fdacc7de29d`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:10.848793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d38c4dbb-2c1f-4e81-947b-c761d6475501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:10.905741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:10.907368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:10.907912 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:10.908243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] PATH_INFO: `/v3/projects/91c5762027a4404291fc061064a693ec` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:10.910220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91c5762027a4404291fc061064a693ec)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:10.913540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:10.963304 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1002/2009] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:10 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:10.975671 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c4dbb-2c1f-4e81-947b-c761d6475501 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:10.977505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d38c4dbb-2c1f-4e81-947b-c761d6475501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:10.977617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91c5762027a4404291fc061064a693ec', 'request_id': 'req-1b26e150-4250-4458-9114-196d76e06b75'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:10.985998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91c5762027a4404291fc061064a693ec', 'request_id': 'req-1b26e150-4250-4458-9114-196d76e06b75'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:10.994197 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91c5762027a4404291fc061064a693ec', 'request_id': 'req-1b26e150-4250-4458-9114-196d76e06b75'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.006433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] The token cache is being invalidate because project 91c5762027a4404291fc061064a693ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:11.006694 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.007370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.009116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1008/2010] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:10 2021] DELETE /identity/v3/projects/91c5762027a4404291fc061064a693ec => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:11.013117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:11.015038 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:11.044096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c4dbb-2c1f-4e81-947b-c761d6475501 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:11.084771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26e150-4250-4458-9114-196d76e06b75 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:11.089878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:11.090838 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:11.091184 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:11.091642 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] PATH_INFO: `/v3/users/cc3cab699e0545d88671fa6a7281087f` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:11.093010 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc3cab699e0545d88671fa6a7281087f)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:11.095143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:11.102009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b6bda9-f5e1-4341-8c0c-19ad09313ee1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:11.102009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6bda9-f5e1-4341-8c0c-19ad09313ee1 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:11.102009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6bda9-f5e1-4341-8c0c-19ad09313ee1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:11.102009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b6bda9-f5e1-4341-8c0c-19ad09313ee1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:11.102317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-03b6bda9-f5e1-4341-8c0c-19ad09313ee1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:11.154850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc3cab699e0545d88671fa6a7281087f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.177300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc3cab699e0545d88671fa6a7281087f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.178405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc3cab699e0545d88671fa6a7281087f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.188803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc3cab699e0545d88671fa6a7281087f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.192341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6bda9-f5e1-4341-8c0c-19ad09313ee1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:11.195192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b6bda9-f5e1-4341-8c0c-19ad09313ee1 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:11.199532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc3cab699e0545d88671fa6a7281087f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.207209 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1009/2011] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:11 2021] DELETE /identity/v3/users/cc3cab699e0545d88671fa6a7281087f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:11.208057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1003/2012] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:10 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:11.729408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:11.731552 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:11.811068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3e6b1-c808-4e36-b8ab-2c80ea2a0965 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:11.820531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:11.822088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:11.822573 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:11.823029 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] PATH_INFO: `/v3/projects/a4610905e90243788775b392ebcf446c` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:11.824749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4610905e90243788775b392ebcf446c)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:11.826675 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:11.888752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4610905e90243788775b392ebcf446c', 'request_id': 'req-6385e167-5e03-4c86-85fc-7ad2e53f2803'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.899435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4610905e90243788775b392ebcf446c', 'request_id': 'req-6385e167-5e03-4c86-85fc-7ad2e53f2803'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.906054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4610905e90243788775b392ebcf446c', 'request_id': 'req-6385e167-5e03-4c86-85fc-7ad2e53f2803'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.917200 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] The token cache is being invalidate because project a4610905e90243788775b392ebcf446c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:11.917490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.918249 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6385e167-5e03-4c86-85fc-7ad2e53f2803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:11.920264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1010/2013] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:11 2021] DELETE /identity/v3/projects/a4610905e90243788775b392ebcf446c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:11.927093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdda599-388b-437b-b023-f9f4286a1c2b None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:11.927794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdda599-388b-437b-b023-f9f4286a1c2b None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:11.927794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdda599-388b-437b-b023-f9f4286a1c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:11.946862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-8fdda599-388b-437b-b023-f9f4286a1c2b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:11.948053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8fdda599-388b-437b-b023-f9f4286a1c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:12.018113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1004/2014] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:12.027300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93175283-2e11-4305-9a90-3d5eda6f6129 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.027589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93175283-2e11-4305-9a90-3d5eda6f6129 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.027869 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93175283-2e11-4305-9a90-3d5eda6f6129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.053113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-93175283-2e11-4305-9a90-3d5eda6f6129 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:12.054554 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-93175283-2e11-4305-9a90-3d5eda6f6129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:12.063493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1011/2015] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:12.068750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdda599-388b-437b-b023-f9f4286a1c2b None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.083811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdda599-388b-437b-b023-f9f4286a1c2b None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.088978 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d159-726c-4c0e-a1b1-1424d6d2eb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.089669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d159-726c-4c0e-a1b1-1424d6d2eb6a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.089948 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d159-726c-4c0e-a1b1-1424d6d2eb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.090225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5d159-726c-4c0e-a1b1-1424d6d2eb6a admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.090983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d159-726c-4c0e-a1b1-1424d6d2eb6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:12.091359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d159-726c-4c0e-a1b1-1424d6d2eb6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.092992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b5d159-726c-4c0e-a1b1-1424d6d2eb6a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.107680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1005/2016] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:12.112875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93175283-2e11-4305-9a90-3d5eda6f6129 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.127356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93175283-2e11-4305-9a90-3d5eda6f6129 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.135538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d7375-c5b1-476d-991e-c5fb79bb1b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.136228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d7375-c5b1-476d-991e-c5fb79bb1b9c admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.136513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d7375-c5b1-476d-991e-c5fb79bb1b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.136838 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d7375-c5b1-476d-991e-c5fb79bb1b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.137541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d7375-c5b1-476d-991e-c5fb79bb1b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.139486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d7375-c5b1-476d-991e-c5fb79bb1b9c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.170246 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1012/2017] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:12 2021] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:12.174607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d159-726c-4c0e-a1b1-1424d6d2eb6a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.185158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5d159-726c-4c0e-a1b1-1424d6d2eb6a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.247698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b4af6-654a-4460-b620-d0d9515201e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.248393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b4af6-654a-4460-b620-d0d9515201e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.248709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b4af6-654a-4460-b620-d0d9515201e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.248987 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2b4af6-654a-4460-b620-d0d9515201e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.249772 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b4af6-654a-4460-b620-d0d9515201e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.252688 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2b4af6-654a-4460-b620-d0d9515201e0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.284809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1006/2018] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:12 2021] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:12.285107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d7375-c5b1-476d-991e-c5fb79bb1b9c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.297437 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d7375-c5b1-476d-991e-c5fb79bb1b9c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.303921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af373dec-5db3-43d4-92a0-02fa8e947e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.304668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af373dec-5db3-43d4-92a0-02fa8e947e51 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.304823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af373dec-5db3-43d4-92a0-02fa8e947e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.305204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af373dec-5db3-43d4-92a0-02fa8e947e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.305844 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af373dec-5db3-43d4-92a0-02fa8e947e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.307456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af373dec-5db3-43d4-92a0-02fa8e947e51 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.322383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1013/2019] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:12.323733 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b4af6-654a-4460-b620-d0d9515201e0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.335211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2b4af6-654a-4460-b620-d0d9515201e0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.340068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e6d06-6433-49e6-96d0-9334d9e13979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.340898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e6d06-6433-49e6-96d0-9334d9e13979 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.341271 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e6d06-6433-49e6-96d0-9334d9e13979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.341651 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e6d06-6433-49e6-96d0-9334d9e13979 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.343036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e6d06-6433-49e6-96d0-9334d9e13979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.344320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e6d06-6433-49e6-96d0-9334d9e13979 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.355362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1007/2020] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:12.359775 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af373dec-5db3-43d4-92a0-02fa8e947e51 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.371003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af373dec-5db3-43d4-92a0-02fa8e947e51 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.376665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631824d9-060c-4816-bded-f2710779865d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.377568 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631824d9-060c-4816-bded-f2710779865d admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.377903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631824d9-060c-4816-bded-f2710779865d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.378178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631824d9-060c-4816-bded-f2710779865d admin admin] PATH_INFO: `/v3/projects/eb3fdea543b54a11acde81315482f194/users/d8df2471b0cd49e8a8106a23ce01d886/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.393765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631824d9-060c-4816-bded-f2710779865d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb3fdea543b54a11acde81315482f194, user_id=d8df2471b0cd49e8a8106a23ce01d886, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.396492 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631824d9-060c-4816-bded-f2710779865d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.414844 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1014/2021] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:12 2021] PUT /identity/v3/projects/eb3fdea543b54a11acde81315482f194/users/d8df2471b0cd49e8a8106a23ce01d886/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:12.425694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c50fe-85d0-43a1-91c0-a1c103e0ecc8 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.426100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c50fe-85d0-43a1-91c0-a1c103e0ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.426416 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c50fe-85d0-43a1-91c0-a1c103e0ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.454592 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-9e9c50fe-85d0-43a1-91c0-a1c103e0ecc8 None None] MFA Rules not processed for user `d8df2471b0cd49e8a8106a23ce01d886`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:12.455810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9e9c50fe-85d0-43a1-91c0-a1c103e0ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:12.531988 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1008/2022] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:12 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:12.538239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631824d9-060c-4816-bded-f2710779865d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.611243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631824d9-060c-4816-bded-f2710779865d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.616547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98c465-5c16-40f2-83a7-6eeb9c02d67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.617239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98c465-5c16-40f2-83a7-6eeb9c02d67d admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.617515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98c465-5c16-40f2-83a7-6eeb9c02d67d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.617785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98c465-5c16-40f2-83a7-6eeb9c02d67d admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.618502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98c465-5c16-40f2-83a7-6eeb9c02d67d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.620396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98c465-5c16-40f2-83a7-6eeb9c02d67d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.651831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1015/2023] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:12 2021] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:12.656052 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c50fe-85d0-43a1-91c0-a1c103e0ecc8 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.668747 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c50fe-85d0-43a1-91c0-a1c103e0ecc8 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.744971 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e8aea-0bc2-4c22-82b4-6a5d8b07fedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.745716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8aea-0bc2-4c22-82b4-6a5d8b07fedb admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.745976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8aea-0bc2-4c22-82b4-6a5d8b07fedb admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.746253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e8aea-0bc2-4c22-82b4-6a5d8b07fedb admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.747325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e8aea-0bc2-4c22-82b4-6a5d8b07fedb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.749317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e8aea-0bc2-4c22-82b4-6a5d8b07fedb admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.771254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1009/2024] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:12 2021] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:12.775901 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98c465-5c16-40f2-83a7-6eeb9c02d67d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.786884 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98c465-5c16-40f2-83a7-6eeb9c02d67d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.792076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38727c79-bef8-4907-b10a-1cdf6a0b184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.792781 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38727c79-bef8-4907-b10a-1cdf6a0b184b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.793073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38727c79-bef8-4907-b10a-1cdf6a0b184b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.793345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38727c79-bef8-4907-b10a-1cdf6a0b184b admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.794085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38727c79-bef8-4907-b10a-1cdf6a0b184b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.795685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38727c79-bef8-4907-b10a-1cdf6a0b184b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.811272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1016/2025] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:12.813590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e8aea-0bc2-4c22-82b4-6a5d8b07fedb admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.825109 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e8aea-0bc2-4c22-82b4-6a5d8b07fedb admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.830788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab053937-3580-4e9a-8c6f-f53f2774af2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.831898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053937-3580-4e9a-8c6f-f53f2774af2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.832164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053937-3580-4e9a-8c6f-f53f2774af2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.832422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab053937-3580-4e9a-8c6f-f53f2774af2c admin admin] PATH_INFO: `/v3/projects/c51775a205c8402596699f4388527acf/users/7fda258da0e6417b92249bf5974813c4/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.849671 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab053937-3580-4e9a-8c6f-f53f2774af2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51775a205c8402596699f4388527acf, user_id=7fda258da0e6417b92249bf5974813c4, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.852374 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab053937-3580-4e9a-8c6f-f53f2774af2c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.868837 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1010/2026] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:12 2021] PUT /identity/v3/projects/c51775a205c8402596699f4388527acf/users/7fda258da0e6417b92249bf5974813c4/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:12.873407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38727c79-bef8-4907-b10a-1cdf6a0b184b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.884300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38727c79-bef8-4907-b10a-1cdf6a0b184b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.941642 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc29cb3-563e-4e80-ada0-b97ef9d5bebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.942348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29cb3-563e-4e80-ada0-b97ef9d5bebf admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.942627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29cb3-563e-4e80-ada0-b97ef9d5bebf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.942933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29cb3-563e-4e80-ada0-b97ef9d5bebf admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.943668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc29cb3-563e-4e80-ada0-b97ef9d5bebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.945333 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc29cb3-563e-4e80-ada0-b97ef9d5bebf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.956628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1017/2027] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:12 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:12.961238 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab053937-3580-4e9a-8c6f-f53f2774af2c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:12.971789 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab053937-3580-4e9a-8c6f-f53f2774af2c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:12.976603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba107f-c9fa-4f48-be09-60ea0102dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:12.977567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba107f-c9fa-4f48-be09-60ea0102dfac admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:12.977847 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba107f-c9fa-4f48-be09-60ea0102dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:12.978125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba107f-c9fa-4f48-be09-60ea0102dfac admin admin] PATH_INFO: `/v3/projects/c51775a205c8402596699f4388527acf/users/7fda258da0e6417b92249bf5974813c4/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:12.980203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba107f-c9fa-4f48-be09-60ea0102dfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c51775a205c8402596699f4388527acf, user_id=7fda258da0e6417b92249bf5974813c4, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:12.982858 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba107f-c9fa-4f48-be09-60ea0102dfac admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:12.996819 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1011/2028] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:12 2021] PUT /identity/v3/projects/c51775a205c8402596699f4388527acf/users/7fda258da0e6417b92249bf5974813c4/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:13.006194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecd12e-0fd3-4f1a-83ab-0eeddcf31456 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:13.006485 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecd12e-0fd3-4f1a-83ab-0eeddcf31456 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:13.006769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ecd12e-0fd3-4f1a-83ab-0eeddcf31456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:13.037657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-04ecd12e-0fd3-4f1a-83ab-0eeddcf31456 None None] MFA Rules not processed for user `7fda258da0e6417b92249bf5974813c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:13.038881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-04ecd12e-0fd3-4f1a-83ab-0eeddcf31456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:13.148936 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1018/2029] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:13 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:13.165563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba107f-c9fa-4f48-be09-60ea0102dfac admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:13.167590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-33ba107f-c9fa-4f48-be09-60ea0102dfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:13.233796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba107f-c9fa-4f48-be09-60ea0102dfac admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:13.237695 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424ddc7-de5f-421f-bd36-aa13e16b9b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:13.238480 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ddc7-de5f-421f-bd36-aa13e16b9b4a service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:13.239484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ddc7-de5f-421f-bd36-aa13e16b9b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:13.239654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424ddc7-de5f-421f-bd36-aa13e16b9b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:13.251082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424ddc7-de5f-421f-bd36-aa13e16b9b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:13.252518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424ddc7-de5f-421f-bd36-aa13e16b9b4a service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:13.270845 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1012/2030] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:13 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:13.912975 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecd12e-0fd3-4f1a-83ab-0eeddcf31456 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:13.978402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ecd12e-0fd3-4f1a-83ab-0eeddcf31456 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:13.985075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:13.985957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:13.986236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:13.986486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] PATH_INFO: `/v3/users/d8df2471b0cd49e8a8106a23ce01d886` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:13.988280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8df2471b0cd49e8a8106a23ce01d886)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:13.990225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:14.060055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8df2471b0cd49e8a8106a23ce01d886'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.078840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8df2471b0cd49e8a8106a23ce01d886'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.080154 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8df2471b0cd49e8a8106a23ce01d886'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.088129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8df2471b0cd49e8a8106a23ce01d886'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.098075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8df2471b0cd49e8a8106a23ce01d886'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.105004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1019/2031] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:13 2021] DELETE /identity/v3/users/d8df2471b0cd49e8a8106a23ce01d886 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:14.109803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d18fc4-4202-46a9-81af-6589152ded96 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:14.110751 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d18fc4-4202-46a9-81af-6589152ded96 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:14.111247 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d18fc4-4202-46a9-81af-6589152ded96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:14.135570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-29d18fc4-4202-46a9-81af-6589152ded96 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:14.137262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-29d18fc4-4202-46a9-81af-6589152ded96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:14.211900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1013/2032] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:14.222828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:14.224435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:14.290771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14bb6a-d5e7-433d-b979-2103c9fe8bb2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:14.294569 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acf322-5497-481b-9615-606b3ffdadb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:14.295223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf322-5497-481b-9615-606b3ffdadb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:14.295502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf322-5497-481b-9615-606b3ffdadb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:14.295795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acf322-5497-481b-9615-606b3ffdadb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:14.307770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acf322-5497-481b-9615-606b3ffdadb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:14.309302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acf322-5497-481b-9615-606b3ffdadb9 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:14.319529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1020/2033] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:14.688408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d18fc4-4202-46a9-81af-6589152ded96 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:14.690594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-29d18fc4-4202-46a9-81af-6589152ded96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:14.716902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d18fc4-4202-46a9-81af-6589152ded96 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:14.725010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:14.725906 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:14.726187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:14.726529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] PATH_INFO: `/v3/projects/eb3fdea543b54a11acde81315482f194` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:14.728016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb3fdea543b54a11acde81315482f194)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:14.730086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:14.788908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb3fdea543b54a11acde81315482f194', 'request_id': 'req-90e26335-0b36-48df-9223-0d63c3d6f6b3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.798554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb3fdea543b54a11acde81315482f194', 'request_id': 'req-90e26335-0b36-48df-9223-0d63c3d6f6b3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.805331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb3fdea543b54a11acde81315482f194', 'request_id': 'req-90e26335-0b36-48df-9223-0d63c3d6f6b3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.822317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] The token cache is being invalidate because project eb3fdea543b54a11acde81315482f194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:14.822317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.822317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.822317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1014/2034] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:14 2021] DELETE /identity/v3/projects/eb3fdea543b54a11acde81315482f194 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:14.826385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acf322-5497-481b-9615-606b3ffdadb9 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:14.836521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acf322-5497-481b-9615-606b3ffdadb9 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:14.898183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b73c8-9c5a-4ebb-ae18-9274246eb200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:14.899489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b73c8-9c5a-4ebb-ae18-9274246eb200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:14.899773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b73c8-9c5a-4ebb-ae18-9274246eb200 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:14.900140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b73c8-9c5a-4ebb-ae18-9274246eb200 admin admin] PATH_INFO: `/v3/users/7fda258da0e6417b92249bf5974813c4` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:14.902147 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b73c8-9c5a-4ebb-ae18-9274246eb200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fda258da0e6417b92249bf5974813c4)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:14.904928 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b73c8-9c5a-4ebb-ae18-9274246eb200 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:14.964559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-913b73c8-9c5a-4ebb-ae18-9274246eb200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fda258da0e6417b92249bf5974813c4'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.978521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-913b73c8-9c5a-4ebb-ae18-9274246eb200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fda258da0e6417b92249bf5974813c4'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.979276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-913b73c8-9c5a-4ebb-ae18-9274246eb200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fda258da0e6417b92249bf5974813c4'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.986722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-913b73c8-9c5a-4ebb-ae18-9274246eb200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fda258da0e6417b92249bf5974813c4'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:14.995480 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-913b73c8-9c5a-4ebb-ae18-9274246eb200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fda258da0e6417b92249bf5974813c4'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:15.003048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1021/2035] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:14 2021] DELETE /identity/v3/users/7fda258da0e6417b92249bf5974813c4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:15.411541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:15.414005 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:15.445514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e26335-0b36-48df-9223-0d63c3d6f6b3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:15.545976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:15.547073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:15.547467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:15.547661 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] PATH_INFO: `/v3/projects/c51775a205c8402596699f4388527acf` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:15.550919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c51775a205c8402596699f4388527acf)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:15.553000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:15.672937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c51775a205c8402596699f4388527acf', 'request_id': 'req-3ceb1e85-7328-4671-8aab-d5945dc38da2'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:15.692665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c51775a205c8402596699f4388527acf', 'request_id': 'req-3ceb1e85-7328-4671-8aab-d5945dc38da2'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:15.706404 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c51775a205c8402596699f4388527acf', 'request_id': 'req-3ceb1e85-7328-4671-8aab-d5945dc38da2'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:15.728702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] The token cache is being invalidate because project c51775a205c8402596699f4388527acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:15.728702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:15.729536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3ceb1e85-7328-4671-8aab-d5945dc38da2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:15.739557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1015/2036] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:15 2021] DELETE /identity/v3/projects/c51775a205c8402596699f4388527acf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:15.741749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045ab48-ef1e-4b96-b28e-cff7350bf29e None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:15.742508 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045ab48-ef1e-4b96-b28e-cff7350bf29e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:15.742508 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045ab48-ef1e-4b96-b28e-cff7350bf29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:15.819856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-4045ab48-ef1e-4b96-b28e-cff7350bf29e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:15.822547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4045ab48-ef1e-4b96-b28e-cff7350bf29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:15.930492 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1022/2037] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:15.939049 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d09484-bba3-422d-9425-c17f56c22ea2 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:15.939894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d09484-bba3-422d-9425-c17f56c22ea2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:15.940301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d09484-bba3-422d-9425-c17f56c22ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:15.969476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-76d09484-bba3-422d-9425-c17f56c22ea2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:15.971169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-76d09484-bba3-422d-9425-c17f56c22ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:15.991570 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045ab48-ef1e-4b96-b28e-cff7350bf29e None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:15.995511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4045ab48-ef1e-4b96-b28e-cff7350bf29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:15.997245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1016/2038] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:16.005319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d09484-bba3-422d-9425-c17f56c22ea2 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:16.014684 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d09484-bba3-422d-9425-c17f56c22ea2 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.020798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4045ab48-ef1e-4b96-b28e-cff7350bf29e None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.023247 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d15eb2-6a0e-4419-a1a4-0245ba8f8d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.025031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d15eb2-6a0e-4419-a1a4-0245ba8f8d6f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.026466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d15eb2-6a0e-4419-a1a4-0245ba8f8d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.026725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf97f5a-8fea-4f7f-83ac-7ea69339f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.027154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d15eb2-6a0e-4419-a1a4-0245ba8f8d6f admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.027772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf97f5a-8fea-4f7f-83ac-7ea69339f064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.028122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf97f5a-8fea-4f7f-83ac-7ea69339f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.028413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d15eb2-6a0e-4419-a1a4-0245ba8f8d6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:16.028530 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf97f5a-8fea-4f7f-83ac-7ea69339f064 admin admin] PATH_INFO: `/v3/users/4a90ba1ef8f248a083d05f65b1d6f9c0` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.029000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d15eb2-6a0e-4419-a1a4-0245ba8f8d6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:16.030116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf97f5a-8fea-4f7f-83ac-7ea69339f064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a90ba1ef8f248a083d05f65b1d6f9c0)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:16.032193 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d15eb2-6a0e-4419-a1a4-0245ba8f8d6f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:16.033509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf97f5a-8fea-4f7f-83ac-7ea69339f064 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:16.049138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1017/2039] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:16.059867 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d15eb2-6a0e-4419-a1a4-0245ba8f8d6f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:16.076436 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d15eb2-6a0e-4419-a1a4-0245ba8f8d6f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.081775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607c281-f382-4603-abd5-eca98aef1b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.082860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607c281-f382-4603-abd5-eca98aef1b34 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.083146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607c281-f382-4603-abd5-eca98aef1b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.083686 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4607c281-f382-4603-abd5-eca98aef1b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.084407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607c281-f382-4603-abd5-eca98aef1b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:16.086394 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4607c281-f382-4603-abd5-eca98aef1b34 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:16.104088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8bf97f5a-8fea-4f7f-83ac-7ea69339f064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a90ba1ef8f248a083d05f65b1d6f9c0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:16.119689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8bf97f5a-8fea-4f7f-83ac-7ea69339f064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a90ba1ef8f248a083d05f65b1d6f9c0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:16.120798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8bf97f5a-8fea-4f7f-83ac-7ea69339f064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a90ba1ef8f248a083d05f65b1d6f9c0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:16.123473 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1018/2040] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:16 2021] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:16.124710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607c281-f382-4603-abd5-eca98aef1b34 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:16.130792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8bf97f5a-8fea-4f7f-83ac-7ea69339f064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a90ba1ef8f248a083d05f65b1d6f9c0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:16.142117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8bf97f5a-8fea-4f7f-83ac-7ea69339f064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a90ba1ef8f248a083d05f65b1d6f9c0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:16.153878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1023/2041] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:15 2021] DELETE /identity/v3/users/4a90ba1ef8f248a083d05f65b1d6f9c0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:16.156102 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e69e-8e17-49b1-b9e6-efd55b11775f None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.156619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e69e-8e17-49b1-b9e6-efd55b11775f None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.157071 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540e69e-8e17-49b1-b9e6-efd55b11775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.177456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e540e69e-8e17-49b1-b9e6-efd55b11775f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:16.179020 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e540e69e-8e17-49b1-b9e6-efd55b11775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:16.197011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4607c281-f382-4603-abd5-eca98aef1b34 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.244836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1024/2042] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:16 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:16.259329 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540e69e-8e17-49b1-b9e6-efd55b11775f None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:16.260994 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e540e69e-8e17-49b1-b9e6-efd55b11775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:16.271372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914c102-d76f-496d-80e9-6a1d5b49c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.272060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914c102-d76f-496d-80e9-6a1d5b49c89d admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.272342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914c102-d76f-496d-80e9-6a1d5b49c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.272636 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914c102-d76f-496d-80e9-6a1d5b49c89d admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.273353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914c102-d76f-496d-80e9-6a1d5b49c89d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:16.275287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914c102-d76f-496d-80e9-6a1d5b49c89d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:16.300677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1019/2043] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:16 2021] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:16.302028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914c102-d76f-496d-80e9-6a1d5b49c89d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:16.303756 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1914c102-d76f-496d-80e9-6a1d5b49c89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:16.315314 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914c102-d76f-496d-80e9-6a1d5b49c89d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.319813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540e69e-8e17-49b1-b9e6-efd55b11775f None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.321002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0769a4-cee3-4f6f-baaf-98bf8d7b3679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.321686 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0769a4-cee3-4f6f-baaf-98bf8d7b3679 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.321961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0769a4-cee3-4f6f-baaf-98bf8d7b3679 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.322234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0769a4-cee3-4f6f-baaf-98bf8d7b3679 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.323218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0769a4-cee3-4f6f-baaf-98bf8d7b3679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:16.324533 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930ded0-45e7-4a69-9d12-0300297492fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.324700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0769a4-cee3-4f6f-baaf-98bf8d7b3679 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:16.325549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930ded0-45e7-4a69-9d12-0300297492fb service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.326037 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930ded0-45e7-4a69-9d12-0300297492fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.326534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930ded0-45e7-4a69-9d12-0300297492fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.337536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930ded0-45e7-4a69-9d12-0300297492fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:16.339487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930ded0-45e7-4a69-9d12-0300297492fb service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:16.341867 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1020/2044] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:16 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:16.350170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0769a4-cee3-4f6f-baaf-98bf8d7b3679 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:16.351306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1025/2045] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:16 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:16.364783 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0769a4-cee3-4f6f-baaf-98bf8d7b3679 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.372298 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818979d1-ecf0-4cd6-9381-eb4f5b1885de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.373019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818979d1-ecf0-4cd6-9381-eb4f5b1885de admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.373301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818979d1-ecf0-4cd6-9381-eb4f5b1885de admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.373574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818979d1-ecf0-4cd6-9381-eb4f5b1885de admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.374315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818979d1-ecf0-4cd6-9381-eb4f5b1885de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:16.375940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818979d1-ecf0-4cd6-9381-eb4f5b1885de admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:16.387151 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1021/2046] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:16 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:16.391950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930ded0-45e7-4a69-9d12-0300297492fb service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:16.403021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930ded0-45e7-4a69-9d12-0300297492fb service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.407692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae39d73-460f-4bc1-ab51-07b49ad1edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.408622 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae39d73-460f-4bc1-ab51-07b49ad1edd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.408885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae39d73-460f-4bc1-ab51-07b49ad1edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.409280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae39d73-460f-4bc1-ab51-07b49ad1edd7 admin admin] PATH_INFO: `/v3/projects/26382e70d37f4b83bf7882a2b3df8d39/users/c83cf2e9af5c45a7b83fe6fc3176c26b/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.428802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae39d73-460f-4bc1-ab51-07b49ad1edd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26382e70d37f4b83bf7882a2b3df8d39, user_id=c83cf2e9af5c45a7b83fe6fc3176c26b, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:16.431592 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae39d73-460f-4bc1-ab51-07b49ad1edd7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:16.449673 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1026/2047] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:16 2021] PUT /identity/v3/projects/26382e70d37f4b83bf7882a2b3df8d39/users/c83cf2e9af5c45a7b83fe6fc3176c26b/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:16.463831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d8fc-5539-49d7-ada0-2dc10f97caf0 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.465122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d8fc-5539-49d7-ada0-2dc10f97caf0 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.465425 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116d8fc-5539-49d7-ada0-2dc10f97caf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.502519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-b116d8fc-5539-49d7-ada0-2dc10f97caf0 None None] MFA Rules not processed for user `c83cf2e9af5c45a7b83fe6fc3176c26b`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:16.503827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b116d8fc-5539-49d7-ada0-2dc10f97caf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:16.593142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1022/2048] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:16 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:16.598034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae39d73-460f-4bc1-ab51-07b49ad1edd7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:16.700197 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae39d73-460f-4bc1-ab51-07b49ad1edd7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.708213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813b732-1c31-47dc-9af0-9a2d2dd6f48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.708939 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813b732-1c31-47dc-9af0-9a2d2dd6f48d admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.709220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813b732-1c31-47dc-9af0-9a2d2dd6f48d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.709817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813b732-1c31-47dc-9af0-9a2d2dd6f48d admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.710225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813b732-1c31-47dc-9af0-9a2d2dd6f48d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:16.712435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813b732-1c31-47dc-9af0-9a2d2dd6f48d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:16.757859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1027/2049] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:16 2021] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:16.758066 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116d8fc-5539-49d7-ada0-2dc10f97caf0 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:16.775328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116d8fc-5539-49d7-ada0-2dc10f97caf0 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.878997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334b09-9aee-4d9f-94d0-f3d222db237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.879812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334b09-9aee-4d9f-94d0-f3d222db237b admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.880029 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334b09-9aee-4d9f-94d0-f3d222db237b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.880353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e334b09-9aee-4d9f-94d0-f3d222db237b admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.881323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334b09-9aee-4d9f-94d0-f3d222db237b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:16.883434 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e334b09-9aee-4d9f-94d0-f3d222db237b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:16.915993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1023/2050] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:16 2021] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:16.919849 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813b732-1c31-47dc-9af0-9a2d2dd6f48d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:16.932349 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813b732-1c31-47dc-9af0-9a2d2dd6f48d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.937556 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30256c-ffee-4292-aeaf-5bffa5574bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.938234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30256c-ffee-4292-aeaf-5bffa5574bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.938765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30256c-ffee-4292-aeaf-5bffa5574bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:16.939195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30256c-ffee-4292-aeaf-5bffa5574bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:16.939951 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30256c-ffee-4292-aeaf-5bffa5574bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:16.941722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30256c-ffee-4292-aeaf-5bffa5574bd2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:16.954522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1028/2051] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:16 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:16.959357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334b09-9aee-4d9f-94d0-f3d222db237b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:16.972935 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e334b09-9aee-4d9f-94d0-f3d222db237b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:16.979588 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe123f-3feb-42da-99a2-2c2655b3e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:16.997528 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe123f-3feb-42da-99a2-2c2655b3e04f admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:16.999157 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe123f-3feb-42da-99a2-2c2655b3e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:17.000170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe123f-3feb-42da-99a2-2c2655b3e04f admin admin] PATH_INFO: `/v3/projects/5408807adece45f8857bffddd69dcab7/users/ef0ad45c340d4f3baf7a9ac860284067/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:17.036730 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe123f-3feb-42da-99a2-2c2655b3e04f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5408807adece45f8857bffddd69dcab7, user_id=ef0ad45c340d4f3baf7a9ac860284067, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:17.040357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe123f-3feb-42da-99a2-2c2655b3e04f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:17.063558 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1024/2052] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:16 2021] PUT /identity/v3/projects/5408807adece45f8857bffddd69dcab7/users/ef0ad45c340d4f3baf7a9ac860284067/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:17.067782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30256c-ffee-4292-aeaf-5bffa5574bd2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:17.078491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30256c-ffee-4292-aeaf-5bffa5574bd2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:17.152198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cd06b-0663-4ac0-9d15-8b669696eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:17.153222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cd06b-0663-4ac0-9d15-8b669696eea6 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:17.153667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cd06b-0663-4ac0-9d15-8b669696eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:17.154209 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5cd06b-0663-4ac0-9d15-8b669696eea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:17.154983 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cd06b-0663-4ac0-9d15-8b669696eea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:17.156687 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5cd06b-0663-4ac0-9d15-8b669696eea6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:17.167795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1029/2053] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:17 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:17.172863 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe123f-3feb-42da-99a2-2c2655b3e04f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:17.184008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe123f-3feb-42da-99a2-2c2655b3e04f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:17.190231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48057c8-78a6-4b97-9591-ef2a802312e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:17.191422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48057c8-78a6-4b97-9591-ef2a802312e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:17.191730 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48057c8-78a6-4b97-9591-ef2a802312e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:17.192013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48057c8-78a6-4b97-9591-ef2a802312e1 admin admin] PATH_INFO: `/v3/projects/5408807adece45f8857bffddd69dcab7/users/ef0ad45c340d4f3baf7a9ac860284067/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:17.205791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48057c8-78a6-4b97-9591-ef2a802312e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5408807adece45f8857bffddd69dcab7, user_id=ef0ad45c340d4f3baf7a9ac860284067, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:17.210310 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48057c8-78a6-4b97-9591-ef2a802312e1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:17.233245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cd06b-0663-4ac0-9d15-8b669696eea6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:17.235840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ad5cd06b-0663-4ac0-9d15-8b669696eea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:17.240086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1025/2054] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:17 2021] PUT /identity/v3/projects/5408807adece45f8857bffddd69dcab7/users/ef0ad45c340d4f3baf7a9ac860284067/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:17.254973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee89b6-cf62-47e6-9877-a90c328e798f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:17.255589 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee89b6-cf62-47e6-9877-a90c328e798f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:17.256116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5cd06b-0663-4ac0-9d15-8b669696eea6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:17.256316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee89b6-cf62-47e6-9877-a90c328e798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:17.287872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-bfee89b6-cf62-47e6-9877-a90c328e798f None None] MFA Rules not processed for user `ef0ad45c340d4f3baf7a9ac860284067`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:17.289118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-bfee89b6-cf62-47e6-9877-a90c328e798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:17.375890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:17.377472 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:17.378013 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:17.378307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] PATH_INFO: `/v3/projects/57935c2d098c455984aa8b5f87ff29b4` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:17.379739 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57935c2d098c455984aa8b5f87ff29b4)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:17.382014 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:17.399622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1026/2055] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:17 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:17.411108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee89b6-cf62-47e6-9877-a90c328e798f None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:17.412835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-bfee89b6-cf62-47e6-9877-a90c328e798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:17.458281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57935c2d098c455984aa8b5f87ff29b4', 'request_id': 'req-923e473b-cff6-460f-ab32-c185eb91f870'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:17.472801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57935c2d098c455984aa8b5f87ff29b4', 'request_id': 'req-923e473b-cff6-460f-ab32-c185eb91f870'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:17.481397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57935c2d098c455984aa8b5f87ff29b4', 'request_id': 'req-923e473b-cff6-460f-ab32-c185eb91f870'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:17.496745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfee89b6-cf62-47e6-9877-a90c328e798f None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:17.498097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] The token cache is being invalidate because project 57935c2d098c455984aa8b5f87ff29b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:17.498402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:17.499194 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:17.501427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1030/2056] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:17 2021] DELETE /identity/v3/projects/57935c2d098c455984aa8b5f87ff29b4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:17.505702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:17.507419 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:17.565804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826b073-f9dd-4ab7-82f9-cc1666dd19d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:17.566803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b073-f9dd-4ab7-82f9-cc1666dd19d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:17.567122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b073-f9dd-4ab7-82f9-cc1666dd19d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:17.567517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b073-f9dd-4ab7-82f9-cc1666dd19d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:17.570151 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9826b073-f9dd-4ab7-82f9-cc1666dd19d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:17.591729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e473b-cff6-460f-ab32-c185eb91f870 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:17.598080 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:17.598972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:17.599253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:17.599534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] PATH_INFO: `/v3/users/d3902667cf924106b7a295efc6e19c9d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:17.600800 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3902667cf924106b7a295efc6e19c9d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:17.602754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:17.665384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3902667cf924106b7a295efc6e19c9d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:17.677058 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826b073-f9dd-4ab7-82f9-cc1666dd19d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:17.678209 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3902667cf924106b7a295efc6e19c9d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:17.678975 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3902667cf924106b7a295efc6e19c9d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:17.681262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826b073-f9dd-4ab7-82f9-cc1666dd19d6 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:17.686508 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3902667cf924106b7a295efc6e19c9d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:17.696065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1027/2057] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:17 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:17.723695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3902667cf924106b7a295efc6e19c9d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:17.754373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1031/2058] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:17 2021] DELETE /identity/v3/users/d3902667cf924106b7a295efc6e19c9d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:18.236085 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826b073-f9dd-4ab7-82f9-cc1666dd19d6 service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:18.252371 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826b073-f9dd-4ab7-82f9-cc1666dd19d6 service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:18.295342 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:18.296726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:18.342904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:18.345402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:18.345867 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:18.346365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] PATH_INFO: `/v3/projects/30eed81f42bd4e899f7d06fe03397e2f` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:18.349294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30eed81f42bd4e899f7d06fe03397e2f)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:18.353359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:18.386958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554715f-dd74-4355-8f77-8d55d26d827e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:18.403226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678faca-d106-4458-a23f-79f60f9d6ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:18.404790 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678faca-d106-4458-a23f-79f60f9d6ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:18.405363 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678faca-d106-4458-a23f-79f60f9d6ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:18.406310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678faca-d106-4458-a23f-79f60f9d6ee8 admin admin] PATH_INFO: `/v3/users/c83cf2e9af5c45a7b83fe6fc3176c26b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:18.410518 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678faca-d106-4458-a23f-79f60f9d6ee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83cf2e9af5c45a7b83fe6fc3176c26b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:18.413701 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678faca-d106-4458-a23f-79f60f9d6ee8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:18.426531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30eed81f42bd4e899f7d06fe03397e2f', 'request_id': 'req-f64c5adf-40a8-452d-a2bd-8c0a02c86882'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:18.437665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30eed81f42bd4e899f7d06fe03397e2f', 'request_id': 'req-f64c5adf-40a8-452d-a2bd-8c0a02c86882'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:18.447955 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30eed81f42bd4e899f7d06fe03397e2f', 'request_id': 'req-f64c5adf-40a8-452d-a2bd-8c0a02c86882'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:18.461834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] The token cache is being invalidate because project 30eed81f42bd4e899f7d06fe03397e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:18.462227 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:18.462855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f64c5adf-40a8-452d-a2bd-8c0a02c86882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:18.471185 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1028/2059] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:18 2021] DELETE /identity/v3/projects/30eed81f42bd4e899f7d06fe03397e2f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:18.474249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879faea-fbda-4710-aaeb-725b44697f18 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:18.474497 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879faea-fbda-4710-aaeb-725b44697f18 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:18.474802 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879faea-fbda-4710-aaeb-725b44697f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:18.489051 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7678faca-d106-4458-a23f-79f60f9d6ee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83cf2e9af5c45a7b83fe6fc3176c26b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:18.504690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7678faca-d106-4458-a23f-79f60f9d6ee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83cf2e9af5c45a7b83fe6fc3176c26b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:18.505452 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7678faca-d106-4458-a23f-79f60f9d6ee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83cf2e9af5c45a7b83fe6fc3176c26b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:18.508869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-e879faea-fbda-4710-aaeb-725b44697f18 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:18.511207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e879faea-fbda-4710-aaeb-725b44697f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:18.514936 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7678faca-d106-4458-a23f-79f60f9d6ee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83cf2e9af5c45a7b83fe6fc3176c26b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:18.529074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7678faca-d106-4458-a23f-79f60f9d6ee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83cf2e9af5c45a7b83fe6fc3176c26b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:18.539582 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1032/2060] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:18 2021] DELETE /identity/v3/users/c83cf2e9af5c45a7b83fe6fc3176c26b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:18.544237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb01766-8ad4-4141-8a38-41650b491676 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:18.544665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb01766-8ad4-4141-8a38-41650b491676 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:18.545164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb01766-8ad4-4141-8a38-41650b491676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:18.568447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-8bb01766-8ad4-4141-8a38-41650b491676 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:18.570141 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-8bb01766-8ad4-4141-8a38-41650b491676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:18.596042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1029/2061] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:18.604849 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d1483-22db-4e28-a14f-0ce04aa8b365 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:18.605415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d1483-22db-4e28-a14f-0ce04aa8b365 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:18.606121 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d1483-22db-4e28-a14f-0ce04aa8b365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:18.631954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-622d1483-22db-4e28-a14f-0ce04aa8b365 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:18.634461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-622d1483-22db-4e28-a14f-0ce04aa8b365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:18.661621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1033/2062] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:18.669960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb01766-8ad4-4141-8a38-41650b491676 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:18.671376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-8bb01766-8ad4-4141-8a38-41650b491676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:18.739658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1030/2063] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:18.744160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d1483-22db-4e28-a14f-0ce04aa8b365 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:18.757412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d1483-22db-4e28-a14f-0ce04aa8b365 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:18.758126 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb01766-8ad4-4141-8a38-41650b491676 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:18.762684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe837bf4-84be-4213-8b7f-6b099b9df143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:18.763933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe837bf4-84be-4213-8b7f-6b099b9df143 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:18.764219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe837bf4-84be-4213-8b7f-6b099b9df143 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:18.764354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97d1a0-69fc-4964-8cf8-6a4c061f1800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:18.764496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe837bf4-84be-4213-8b7f-6b099b9df143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:18.765239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97d1a0-69fc-4964-8cf8-6a4c061f1800 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:18.765581 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97d1a0-69fc-4964-8cf8-6a4c061f1800 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:18.765917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97d1a0-69fc-4964-8cf8-6a4c061f1800 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:18.766961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97d1a0-69fc-4964-8cf8-6a4c061f1800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:18.767077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97d1a0-69fc-4964-8cf8-6a4c061f1800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:18.769283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97d1a0-69fc-4964-8cf8-6a4c061f1800 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:18.779456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe837bf4-84be-4213-8b7f-6b099b9df143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:18.781171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe837bf4-84be-4213-8b7f-6b099b9df143 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:18.789729 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1031/2064] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:49:18.790762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97d1a0-69fc-4964-8cf8-6a4c061f1800 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:18.792345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1034/2065] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:18.803071 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97d1a0-69fc-4964-8cf8-6a4c061f1800 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:18.810227 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ceaff-644c-40dd-b2af-7861ecbfe091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:18.810974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ceaff-644c-40dd-b2af-7861ecbfe091 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:18.811321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ceaff-644c-40dd-b2af-7861ecbfe091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:18.811660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ceaff-644c-40dd-b2af-7861ecbfe091 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:18.812477 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ceaff-644c-40dd-b2af-7861ecbfe091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:18.814567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ceaff-644c-40dd-b2af-7861ecbfe091 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:18.860645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1032/2066] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:18 2021] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:18.863481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe837bf4-84be-4213-8b7f-6b099b9df143 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:18.875975 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe837bf4-84be-4213-8b7f-6b099b9df143 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:18.973678 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261abf75-7c42-4f62-a8ee-e6046554686f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:18.974412 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261abf75-7c42-4f62-a8ee-e6046554686f admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:18.974685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261abf75-7c42-4f62-a8ee-e6046554686f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:18.974962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261abf75-7c42-4f62-a8ee-e6046554686f admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:18.976005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261abf75-7c42-4f62-a8ee-e6046554686f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:18.978016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261abf75-7c42-4f62-a8ee-e6046554686f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:19.030268 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1035/2067] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:18 2021] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:19.034461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ceaff-644c-40dd-b2af-7861ecbfe091 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:19.048372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ceaff-644c-40dd-b2af-7861ecbfe091 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:19.061844 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692b768-6acb-4bb8-84c2-2cbf19175d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:19.062945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692b768-6acb-4bb8-84c2-2cbf19175d4f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:19.063658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692b768-6acb-4bb8-84c2-2cbf19175d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:19.064224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692b768-6acb-4bb8-84c2-2cbf19175d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:19.065423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692b768-6acb-4bb8-84c2-2cbf19175d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:19.080495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3692b768-6acb-4bb8-84c2-2cbf19175d4f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:19.100652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1033/2068] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:19 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:19.102390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261abf75-7c42-4f62-a8ee-e6046554686f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:19.113382 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261abf75-7c42-4f62-a8ee-e6046554686f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:19.118897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a2533-b7ba-411d-9fce-2b33659e6de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:19.119600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a2533-b7ba-411d-9fce-2b33659e6de4 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:19.120249 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a2533-b7ba-411d-9fce-2b33659e6de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:19.120249 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a2533-b7ba-411d-9fce-2b33659e6de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:19.121239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a2533-b7ba-411d-9fce-2b33659e6de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:19.123375 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a2533-b7ba-411d-9fce-2b33659e6de4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:19.136629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1036/2069] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:19 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:19.140617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692b768-6acb-4bb8-84c2-2cbf19175d4f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:19.153405 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3692b768-6acb-4bb8-84c2-2cbf19175d4f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:19.160861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea42f9-cbf0-4797-bb06-55d7800283b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:19.162082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea42f9-cbf0-4797-bb06-55d7800283b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:19.162431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea42f9-cbf0-4797-bb06-55d7800283b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:19.162791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea42f9-cbf0-4797-bb06-55d7800283b7 admin admin] PATH_INFO: `/v3/projects/e67e3c5df95b4bb0898998d2724c1a2a/users/ba7597955f5647b4bd62333ebd6de1f4/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:19.180801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea42f9-cbf0-4797-bb06-55d7800283b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e67e3c5df95b4bb0898998d2724c1a2a, user_id=ba7597955f5647b4bd62333ebd6de1f4, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:19.183904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea42f9-cbf0-4797-bb06-55d7800283b7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:19.206350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1034/2070] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:19 2021] PUT /identity/v3/projects/e67e3c5df95b4bb0898998d2724c1a2a/users/ba7597955f5647b4bd62333ebd6de1f4/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:19.219446 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72622a-a331-4648-bd24-8b533802f68c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:19.219820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72622a-a331-4648-bd24-8b533802f68c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:19.220006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72622a-a331-4648-bd24-8b533802f68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:19.270928 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-bc72622a-a331-4648-bd24-8b533802f68c None None] MFA Rules not processed for user `ba7597955f5647b4bd62333ebd6de1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:19.298015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bc72622a-a331-4648-bd24-8b533802f68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:19.356409 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea42f9-cbf0-4797-bb06-55d7800283b7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:19.359024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6fea42f9-cbf0-4797-bb06-55d7800283b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:19.403630 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1037/2071] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:19 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:19.410301 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72622a-a331-4648-bd24-8b533802f68c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:19.504147 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72622a-a331-4648-bd24-8b533802f68c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:19.511525 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25622399-3412-4eea-86ce-76ff903db984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:19.512276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25622399-3412-4eea-86ce-76ff903db984 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:19.512556 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25622399-3412-4eea-86ce-76ff903db984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:19.513020 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25622399-3412-4eea-86ce-76ff903db984 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:19.514190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25622399-3412-4eea-86ce-76ff903db984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:19.516512 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25622399-3412-4eea-86ce-76ff903db984 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:19.519196 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea42f9-cbf0-4797-bb06-55d7800283b7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:19.532846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:19.533911 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:19.534292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:19.534693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] PATH_INFO: `/v3/projects/26382e70d37f4b83bf7882a2b3df8d39` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:19.540031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=26382e70d37f4b83bf7882a2b3df8d39)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:19.542234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:19.561996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1038/2072] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:19 2021] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:19.569079 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25622399-3412-4eea-86ce-76ff903db984 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:19.647533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26382e70d37f4b83bf7882a2b3df8d39', 'request_id': 'req-28757866-d708-4249-b875-c5d8d4eacb0c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:19.661354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26382e70d37f4b83bf7882a2b3df8d39', 'request_id': 'req-28757866-d708-4249-b875-c5d8d4eacb0c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:19.670617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26382e70d37f4b83bf7882a2b3df8d39', 'request_id': 'req-28757866-d708-4249-b875-c5d8d4eacb0c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:19.687398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] The token cache is being invalidate because project 26382e70d37f4b83bf7882a2b3df8d39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:19.688714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:19.689967 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:19.692742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1035/2073] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:19 2021] DELETE /identity/v3/projects/26382e70d37f4b83bf7882a2b3df8d39 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:19.703947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:19.713987 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:19.732977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25622399-3412-4eea-86ce-76ff903db984 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:19.891830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28757866-d708-4249-b875-c5d8d4eacb0c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:19.913036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:19.914024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:19.914320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:19.914583 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] PATH_INFO: `/v3/users/ef0ad45c340d4f3baf7a9ac860284067` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:19.919028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef0ad45c340d4f3baf7a9ac860284067)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:19.920870 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158710ac-48ff-4045-8633-23d6b8f87866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:19.921028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:19.928501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158710ac-48ff-4045-8633-23d6b8f87866 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:19.928501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158710ac-48ff-4045-8633-23d6b8f87866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:19.928501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158710ac-48ff-4045-8633-23d6b8f87866 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:19.928501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158710ac-48ff-4045-8633-23d6b8f87866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:19.929702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158710ac-48ff-4045-8633-23d6b8f87866 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:19.973948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1039/2074] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:19 2021] POST /identity/v3/users => generated 298 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:19.980238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158710ac-48ff-4045-8633-23d6b8f87866 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:19.982643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-158710ac-48ff-4045-8633-23d6b8f87866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:20.013034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158710ac-48ff-4045-8633-23d6b8f87866 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:20.027404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f07d9-1a7d-48a1-a18f-225f861eaf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:20.030391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f07d9-1a7d-48a1-a18f-225f861eaf7a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:20.030880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f07d9-1a7d-48a1-a18f-225f861eaf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:20.031509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f07d9-1a7d-48a1-a18f-225f861eaf7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:20.033028 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f07d9-1a7d-48a1-a18f-225f861eaf7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:20.034991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f07d9-1a7d-48a1-a18f-225f861eaf7a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:20.056959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef0ad45c340d4f3baf7a9ac860284067'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:20.068805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1040/2075] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:19 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:20.070284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f07d9-1a7d-48a1-a18f-225f861eaf7a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:20.083846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef0ad45c340d4f3baf7a9ac860284067'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:20.105573 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef0ad45c340d4f3baf7a9ac860284067'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:20.110297 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f07d9-1a7d-48a1-a18f-225f861eaf7a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:20.125398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d3ee8-d952-4f7d-ae83-67c63f9718b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:20.127164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef0ad45c340d4f3baf7a9ac860284067'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:20.128985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3ee8-d952-4f7d-ae83-67c63f9718b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:20.129535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3ee8-d952-4f7d-ae83-67c63f9718b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:20.130348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef0ad45c340d4f3baf7a9ac860284067'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:20.131100 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d3ee8-d952-4f7d-ae83-67c63f9718b5 admin admin] PATH_INFO: `/v3/projects/9d6bd39178514feeb27919eb56d61820/users/17713d68d1274691bcc3af7b2e433fd2/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:20.143936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1036/2076] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:19 2021] DELETE /identity/v3/users/ef0ad45c340d4f3baf7a9ac860284067 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:20.171092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d3ee8-d952-4f7d-ae83-67c63f9718b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6bd39178514feeb27919eb56d61820, user_id=17713d68d1274691bcc3af7b2e433fd2, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:20.173855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d3ee8-d952-4f7d-ae83-67c63f9718b5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:20.206629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1041/2077] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:20 2021] PUT /identity/v3/projects/9d6bd39178514feeb27919eb56d61820/users/17713d68d1274691bcc3af7b2e433fd2/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:20.211838 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:20.215249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:20.256544 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d3ee8-d952-4f7d-ae83-67c63f9718b5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:20.260232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cf1d3ee8-d952-4f7d-ae83-67c63f9718b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:20.356154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb81cc-6bc5-4fd0-ba86-0ea0a1b42067 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:20.373322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d3ee8-d952-4f7d-ae83-67c63f9718b5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:20.378411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c76a5-76ec-4bf6-a834-cb475b2b37f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:20.379152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c76a5-76ec-4bf6-a834-cb475b2b37f5 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:20.379432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c76a5-76ec-4bf6-a834-cb475b2b37f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:20.379753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c76a5-76ec-4bf6-a834-cb475b2b37f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:20.382748 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-637c76a5-76ec-4bf6-a834-cb475b2b37f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:20.468426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484dee0-cd8f-40a1-89de-37bff494a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:20.468724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484dee0-cd8f-40a1-89de-37bff494a4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:20.468861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484dee0-cd8f-40a1-89de-37bff494a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:20.472809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484dee0-cd8f-40a1-89de-37bff494a4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:20.472809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484dee0-cd8f-40a1-89de-37bff494a4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:20.480389 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484dee0-cd8f-40a1-89de-37bff494a4b7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:20.495906 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1037/2078] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:20 2021] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:20.501168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484dee0-cd8f-40a1-89de-37bff494a4b7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:20.517741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c76a5-76ec-4bf6-a834-cb475b2b37f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:20.518319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484dee0-cd8f-40a1-89de-37bff494a4b7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:20.521913 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c76a5-76ec-4bf6-a834-cb475b2b37f5 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:20.528889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6306bee-6271-4de7-877b-8c5cce467a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:20.530900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6306bee-6271-4de7-877b-8c5cce467a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:20.531347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6306bee-6271-4de7-877b-8c5cce467a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:20.531832 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6306bee-6271-4de7-877b-8c5cce467a8e admin admin] PATH_INFO: `/v3/projects/9d6bd39178514feeb27919eb56d61820/users/17713d68d1274691bcc3af7b2e433fd2/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:20.539095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6306bee-6271-4de7-877b-8c5cce467a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6bd39178514feeb27919eb56d61820, user_id=17713d68d1274691bcc3af7b2e433fd2, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:20.542341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6306bee-6271-4de7-877b-8c5cce467a8e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:20.548253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1042/2079] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:20 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:20.560287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1038/2080] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:20 2021] PUT /identity/v3/projects/9d6bd39178514feeb27919eb56d61820/users/17713d68d1274691bcc3af7b2e433fd2/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:20.572870 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651104-346a-43aa-857d-d4ac48996a87 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:20.573516 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651104-346a-43aa-857d-d4ac48996a87 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:20.573886 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f651104-346a-43aa-857d-d4ac48996a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:20.630349 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-2f651104-346a-43aa-857d-d4ac48996a87 None None] MFA Rules not processed for user `17713d68d1274691bcc3af7b2e433fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:20.632655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-2f651104-346a-43aa-857d-d4ac48996a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:20.809460 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1043/2081] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:20 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:20.866931 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6306bee-6271-4de7-877b-8c5cce467a8e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:20.870126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c6306bee-6271-4de7-877b-8c5cce467a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:20.954430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f651104-346a-43aa-857d-d4ac48996a87 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:20.958931 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-2f651104-346a-43aa-857d-d4ac48996a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:20.985339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6306bee-6271-4de7-877b-8c5cce467a8e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:21.003391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6ec71-b178-4e75-8dd0-a93b4b317ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:21.006150 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ec71-b178-4e75-8dd0-a93b4b317ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:21.006713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ec71-b178-4e75-8dd0-a93b4b317ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:21.007040 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6ec71-b178-4e75-8dd0-a93b4b317ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:21.022603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6ec71-b178-4e75-8dd0-a93b4b317ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:21.024000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6ec71-b178-4e75-8dd0-a93b4b317ca0 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:21.052048 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1039/2082] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:20 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:21.208678 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f651104-346a-43aa-857d-d4ac48996a87 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:21.218907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:21.221628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:21.221628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:21.222372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] PATH_INFO: `/v3/projects/5408807adece45f8857bffddd69dcab7` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:21.238806 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5408807adece45f8857bffddd69dcab7)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:21.252367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:21.311463 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6ec71-b178-4e75-8dd0-a93b4b317ca0 service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:21.322069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6ec71-b178-4e75-8dd0-a93b4b317ca0 service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:21.327043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c0bfa-6ae2-44aa-92fb-0c4e478821b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:21.327312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c0bfa-6ae2-44aa-92fb-0c4e478821b6 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:21.327460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c0bfa-6ae2-44aa-92fb-0c4e478821b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:21.327791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c0bfa-6ae2-44aa-92fb-0c4e478821b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:21.329876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8d2c0bfa-6ae2-44aa-92fb-0c4e478821b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:21.399629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5408807adece45f8857bffddd69dcab7', 'request_id': 'req-ca1c7150-64f3-46ce-9585-1aa27629b774'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:21.412730 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5408807adece45f8857bffddd69dcab7', 'request_id': 'req-ca1c7150-64f3-46ce-9585-1aa27629b774'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:21.431016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5408807adece45f8857bffddd69dcab7', 'request_id': 'req-ca1c7150-64f3-46ce-9585-1aa27629b774'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:21.437541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c0bfa-6ae2-44aa-92fb-0c4e478821b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:21.442002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c0bfa-6ae2-44aa-92fb-0c4e478821b6 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:21.448339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] The token cache is being invalidate because project 5408807adece45f8857bffddd69dcab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:21.450902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:21.450902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:21.451420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1044/2083] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:20 2021] DELETE /identity/v3/projects/5408807adece45f8857bffddd69dcab7 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:21.453035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:21.454557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:21.470004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1040/2084] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:21 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:21.471977 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6516-eb18-4e09-b694-0cd39e3f91ac None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:21.471977 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6516-eb18-4e09-b694-0cd39e3f91ac None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:21.472253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c6516-eb18-4e09-b694-0cd39e3f91ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:21.501483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-933c6516-eb18-4e09-b694-0cd39e3f91ac None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:21.503475 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-933c6516-eb18-4e09-b694-0cd39e3f91ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:21.606495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1041/2085] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:21.610272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185334e0-6e2a-49e2-8750-6a3dc7ab18fb None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:21.610729 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185334e0-6e2a-49e2-8750-6a3dc7ab18fb None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:21.611342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185334e0-6e2a-49e2-8750-6a3dc7ab18fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:21.641291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c7150-64f3-46ce-9585-1aa27629b774 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:21.656374 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14042d-6fd5-4b16-89f6-5f4992be7747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:21.657515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14042d-6fd5-4b16-89f6-5f4992be7747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:21.657938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14042d-6fd5-4b16-89f6-5f4992be7747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:21.658522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14042d-6fd5-4b16-89f6-5f4992be7747 admin admin] PATH_INFO: `/v3/users/6ee83b8748314f7c9ac62d4414c8385f` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:21.660432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14042d-6fd5-4b16-89f6-5f4992be7747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee83b8748314f7c9ac62d4414c8385f)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:21.661421 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-185334e0-6e2a-49e2-8750-6a3dc7ab18fb None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:21.662649 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-185334e0-6e2a-49e2-8750-6a3dc7ab18fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:21.663059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14042d-6fd5-4b16-89f6-5f4992be7747 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:21.674443 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1042/2086] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:21.680458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185334e0-6e2a-49e2-8750-6a3dc7ab18fb None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:21.716090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185334e0-6e2a-49e2-8750-6a3dc7ab18fb None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:21.724209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ee0ad-dc12-4b84-b5f9-134cecec1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:21.725441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ee0ad-dc12-4b84-b5f9-134cecec1874 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:21.726741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ee0ad-dc12-4b84-b5f9-134cecec1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:21.727916 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ee0ad-dc12-4b84-b5f9-134cecec1874 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:21.729275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ee0ad-dc12-4b84-b5f9-134cecec1874 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:21.729807 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ee0ad-dc12-4b84-b5f9-134cecec1874 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:21.731982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ee0ad-dc12-4b84-b5f9-134cecec1874 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:21.750543 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1043/2087] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:21.755658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ee0ad-dc12-4b84-b5f9-134cecec1874 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:21.769318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ee0ad-dc12-4b84-b5f9-134cecec1874 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:21.782591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5a14042d-6fd5-4b16-89f6-5f4992be7747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee83b8748314f7c9ac62d4414c8385f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:21.783154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1fb5a-66d5-4273-8860-40b4fa2f6f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:21.784212 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1fb5a-66d5-4273-8860-40b4fa2f6f1d admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:21.785356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1fb5a-66d5-4273-8860-40b4fa2f6f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:21.785979 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1fb5a-66d5-4273-8860-40b4fa2f6f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:21.786861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1fb5a-66d5-4273-8860-40b4fa2f6f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:21.791253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f1fb5a-66d5-4273-8860-40b4fa2f6f1d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:21.802513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5a14042d-6fd5-4b16-89f6-5f4992be7747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee83b8748314f7c9ac62d4414c8385f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:21.803627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5a14042d-6fd5-4b16-89f6-5f4992be7747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee83b8748314f7c9ac62d4414c8385f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:21.819006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5a14042d-6fd5-4b16-89f6-5f4992be7747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee83b8748314f7c9ac62d4414c8385f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:21.831799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5a14042d-6fd5-4b16-89f6-5f4992be7747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee83b8748314f7c9ac62d4414c8385f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:21.841554 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1045/2088] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:21 2021] DELETE /identity/v3/users/6ee83b8748314f7c9ac62d4414c8385f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:21.846131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6871-d421-486a-8083-8db10fa7acea None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:21.846573 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6871-d421-486a-8083-8db10fa7acea None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:21.846770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f6871-d421-486a-8083-8db10fa7acea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:21.848010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1044/2089] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:21 2021] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:21.852675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1fb5a-66d5-4273-8860-40b4fa2f6f1d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:21.854582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b0f1fb5a-66d5-4273-8860-40b4fa2f6f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:21.879058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-af4f6871-d421-486a-8083-8db10fa7acea None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:21.881629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-af4f6871-d421-486a-8083-8db10fa7acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:21.993069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1fb5a-66d5-4273-8860-40b4fa2f6f1d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:21.999418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b655c60-dad5-45be-bb1a-4329ea2217b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:22.000276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655c60-dad5-45be-bb1a-4329ea2217b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.000685 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655c60-dad5-45be-bb1a-4329ea2217b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.001005 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b655c60-dad5-45be-bb1a-4329ea2217b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.001832 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b655c60-dad5-45be-bb1a-4329ea2217b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:22.004168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b655c60-dad5-45be-bb1a-4329ea2217b0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:22.019381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1046/2090] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:22.030734 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f6871-d421-486a-8083-8db10fa7acea None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:22.036644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1045/2091] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:21 2021] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:22.037518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b655c60-dad5-45be-bb1a-4329ea2217b0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:22.041503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-af4f6871-d421-486a-8083-8db10fa7acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:22.045300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1b655c60-dad5-45be-bb1a-4329ea2217b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:22.062065 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f6871-d421-486a-8083-8db10fa7acea None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:22.069885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b830a3-4471-45b6-9e6a-b7f4d8081b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:22.070864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b830a3-4471-45b6-9e6a-b7f4d8081b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.071215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b830a3-4471-45b6-9e6a-b7f4d8081b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.071556 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b830a3-4471-45b6-9e6a-b7f4d8081b28 admin admin] PATH_INFO: `/v3/users/ba7597955f5647b4bd62333ebd6de1f4` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.073111 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b830a3-4471-45b6-9e6a-b7f4d8081b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba7597955f5647b4bd62333ebd6de1f4)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:22.075544 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b830a3-4471-45b6-9e6a-b7f4d8081b28 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:22.156959 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-59b830a3-4471-45b6-9e6a-b7f4d8081b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba7597955f5647b4bd62333ebd6de1f4'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:22.168631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b655c60-dad5-45be-bb1a-4329ea2217b0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:22.180233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c77ac-4f5f-43fc-a5c4-a66b5164f004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:22.181133 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c77ac-4f5f-43fc-a5c4-a66b5164f004 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.181570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c77ac-4f5f-43fc-a5c4-a66b5164f004 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.181845 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5c77ac-4f5f-43fc-a5c4-a66b5164f004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.197051 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-59b830a3-4471-45b6-9e6a-b7f4d8081b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba7597955f5647b4bd62333ebd6de1f4'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:22.198134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-59b830a3-4471-45b6-9e6a-b7f4d8081b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba7597955f5647b4bd62333ebd6de1f4'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:22.204636 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c77ac-4f5f-43fc-a5c4-a66b5164f004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:22.206397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5c77ac-4f5f-43fc-a5c4-a66b5164f004 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:22.216091 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-59b830a3-4471-45b6-9e6a-b7f4d8081b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba7597955f5647b4bd62333ebd6de1f4'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:22.224327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1046/2092] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:22.225292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c77ac-4f5f-43fc-a5c4-a66b5164f004 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:22.228026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-59b830a3-4471-45b6-9e6a-b7f4d8081b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba7597955f5647b4bd62333ebd6de1f4'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:22.236853 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5c77ac-4f5f-43fc-a5c4-a66b5164f004 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:22.237098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1047/2093] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:22 2021] DELETE /identity/v3/users/ba7597955f5647b4bd62333ebd6de1f4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:22.242091 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93288e8d-e31a-4f5c-9871-91fdc6a8026a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.242791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93288e8d-e31a-4f5c-9871-91fdc6a8026a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.242791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93288e8d-e31a-4f5c-9871-91fdc6a8026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.262397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-93288e8d-e31a-4f5c-9871-91fdc6a8026a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:22.263614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-93288e8d-e31a-4f5c-9871-91fdc6a8026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:22.340307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442fdb9-115f-405e-a746-7b810c3409ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:22.341171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442fdb9-115f-405e-a746-7b810c3409ea admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.341474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442fdb9-115f-405e-a746-7b810c3409ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.341824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442fdb9-115f-405e-a746-7b810c3409ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.342683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442fdb9-115f-405e-a746-7b810c3409ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:22.344442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442fdb9-115f-405e-a746-7b810c3409ea admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:22.346398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1048/2094] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:22.356721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93288e8d-e31a-4f5c-9871-91fdc6a8026a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:22.361728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-93288e8d-e31a-4f5c-9871-91fdc6a8026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:22.361959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1047/2095] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:22 2021] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:22.363096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442fdb9-115f-405e-a746-7b810c3409ea admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:22.366287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1442fdb9-115f-405e-a746-7b810c3409ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:22.381603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442fdb9-115f-405e-a746-7b810c3409ea admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:22.387259 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2395d-2f83-4f61-9418-c6c9da420149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:22.388030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2395d-2f83-4f61-9418-c6c9da420149 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.388380 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2395d-2f83-4f61-9418-c6c9da420149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.388764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2395d-2f83-4f61-9418-c6c9da420149 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.389982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2395d-2f83-4f61-9418-c6c9da420149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:22.391670 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc2395d-2f83-4f61-9418-c6c9da420149 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:22.406990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1048/2096] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:22 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:22.408562 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2395d-2f83-4f61-9418-c6c9da420149 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:22.421397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2395d-2f83-4f61-9418-c6c9da420149 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:22.430070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb80c6-bc66-4e50-9f2b-c3f5fec00d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:22.431188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb80c6-bc66-4e50-9f2b-c3f5fec00d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.431546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb80c6-bc66-4e50-9f2b-c3f5fec00d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.431926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb80c6-bc66-4e50-9f2b-c3f5fec00d88 admin admin] PATH_INFO: `/v3/projects/a341212004c7440c8acb6650a09d01f2/users/d027201a8e3343238388fccb7e9d8800/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.450910 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb80c6-bc66-4e50-9f2b-c3f5fec00d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a341212004c7440c8acb6650a09d01f2, user_id=d027201a8e3343238388fccb7e9d8800, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:22.453768 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb80c6-bc66-4e50-9f2b-c3f5fec00d88 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:22.479537 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1049/2097] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:22 2021] PUT /identity/v3/projects/a341212004c7440c8acb6650a09d01f2/users/d027201a8e3343238388fccb7e9d8800/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:22.492060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74d416-2e75-4ed1-9f02-ee9f0a6ebc2a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.492492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74d416-2e75-4ed1-9f02-ee9f0a6ebc2a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.492972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74d416-2e75-4ed1-9f02-ee9f0a6ebc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.514111 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93288e8d-e31a-4f5c-9871-91fdc6a8026a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:22.551110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-0b74d416-2e75-4ed1-9f02-ee9f0a6ebc2a None None] MFA Rules not processed for user `d027201a8e3343238388fccb7e9d8800`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:22.552456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0b74d416-2e75-4ed1-9f02-ee9f0a6ebc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:22.644277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18d84-f993-45af-bb77-2450111a5c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:22.645073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18d84-f993-45af-bb77-2450111a5c2b service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.645354 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18d84-f993-45af-bb77-2450111a5c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.645628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18d84-f993-45af-bb77-2450111a5c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.681315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1050/2098] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:22 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:22.686366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74d416-2e75-4ed1-9f02-ee9f0a6ebc2a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:22.736117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18d84-f993-45af-bb77-2450111a5c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:22.738220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d18d84-f993-45af-bb77-2450111a5c2b service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:22.750603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1049/2099] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:22.773050 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74d416-2e75-4ed1-9f02-ee9f0a6ebc2a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:22.778028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dcd94-c5d7-454f-9ac3-d9e2cc97f1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:22.778708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dcd94-c5d7-454f-9ac3-d9e2cc97f1cd admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.778988 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dcd94-c5d7-454f-9ac3-d9e2cc97f1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.779261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dcd94-c5d7-454f-9ac3-d9e2cc97f1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.779982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dcd94-c5d7-454f-9ac3-d9e2cc97f1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:22.782280 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dcd94-c5d7-454f-9ac3-d9e2cc97f1cd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:22.821390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1051/2100] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:22 2021] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:22.829284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18d84-f993-45af-bb77-2450111a5c2b service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:22.842052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18d84-f993-45af-bb77-2450111a5c2b service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:22.933813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226063e-178e-4ea8-989c-f3e86a74b4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:22.935086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226063e-178e-4ea8-989c-f3e86a74b4ae admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.935928 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226063e-178e-4ea8-989c-f3e86a74b4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.936412 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b226063e-178e-4ea8-989c-f3e86a74b4ae admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.937328 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226063e-178e-4ea8-989c-f3e86a74b4ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:22.940713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b226063e-178e-4ea8-989c-f3e86a74b4ae admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:22.968260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1050/2101] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:22 2021] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:22.973126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dcd94-c5d7-454f-9ac3-d9e2cc97f1cd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:22.985791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dcd94-c5d7-454f-9ac3-d9e2cc97f1cd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:22.994211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687121b-5842-499e-9c26-74acfc10cf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:22.995207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687121b-5842-499e-9c26-74acfc10cf09 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:22.995849 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687121b-5842-499e-9c26-74acfc10cf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:22.996518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687121b-5842-499e-9c26-74acfc10cf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:22.997374 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687121b-5842-499e-9c26-74acfc10cf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:22.999297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687121b-5842-499e-9c26-74acfc10cf09 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:23.016430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1052/2102] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:22 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:23.021397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226063e-178e-4ea8-989c-f3e86a74b4ae admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.041555 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b226063e-178e-4ea8-989c-f3e86a74b4ae admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:23.047884 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86253a26-0a99-46be-afe2-19974f3b34a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:23.048783 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86253a26-0a99-46be-afe2-19974f3b34a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:23.049089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86253a26-0a99-46be-afe2-19974f3b34a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:23.049810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86253a26-0a99-46be-afe2-19974f3b34a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:23.050755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86253a26-0a99-46be-afe2-19974f3b34a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:23.052529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86253a26-0a99-46be-afe2-19974f3b34a3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:23.056179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687121b-5842-499e-9c26-74acfc10cf09 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.058961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8687121b-5842-499e-9c26-74acfc10cf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:23.066323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1051/2103] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:23 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:23.070482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86253a26-0a99-46be-afe2-19974f3b34a3 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.077289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687121b-5842-499e-9c26-74acfc10cf09 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:23.084298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86253a26-0a99-46be-afe2-19974f3b34a3 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:23.086213 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:23.087835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:23.088275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:23.088800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] PATH_INFO: `/v3/projects/386665a7d3c54590817d6a4be1522be7` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:23.090430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386665a7d3c54590817d6a4be1522be7)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:23.091414 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b8b62-04ec-4bb8-8140-221b9c785cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:23.092639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b8b62-04ec-4bb8-8140-221b9c785cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:23.093167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b8b62-04ec-4bb8-8140-221b9c785cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:23.093503 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b8b62-04ec-4bb8-8140-221b9c785cf4 admin admin] PATH_INFO: `/v3/projects/4ed2f02a84844a5cb62fa16c31c3bf4a/users/5a1d5ad621ac41cf87d4235988f6c890/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:23.094169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:23.142580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b8b62-04ec-4bb8-8140-221b9c785cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed2f02a84844a5cb62fa16c31c3bf4a, user_id=5a1d5ad621ac41cf87d4235988f6c890, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:23.146637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b8b62-04ec-4bb8-8140-221b9c785cf4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:23.170976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1052/2104] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:23 2021] PUT /identity/v3/projects/4ed2f02a84844a5cb62fa16c31c3bf4a/users/5a1d5ad621ac41cf87d4235988f6c890/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:23.186595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5354c-71d2-4ce4-aaa1-334765622fb6 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:23.187143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5354c-71d2-4ce4-aaa1-334765622fb6 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:23.187632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5354c-71d2-4ce4-aaa1-334765622fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:23.221811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386665a7d3c54590817d6a4be1522be7', 'request_id': 'req-35a4aec4-d03f-45cd-b57d-415fabb25b05'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.238653 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386665a7d3c54590817d6a4be1522be7', 'request_id': 'req-35a4aec4-d03f-45cd-b57d-415fabb25b05'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.248785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-6bd5354c-71d2-4ce4-aaa1-334765622fb6 None None] MFA Rules not processed for user `5a1d5ad621ac41cf87d4235988f6c890`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:23.250908 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6bd5354c-71d2-4ce4-aaa1-334765622fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:23.254874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386665a7d3c54590817d6a4be1522be7', 'request_id': 'req-35a4aec4-d03f-45cd-b57d-415fabb25b05'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.292396 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] The token cache is being invalidate because project 386665a7d3c54590817d6a4be1522be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:23.292778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.293990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.296013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1053/2105] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:23 2021] DELETE /identity/v3/projects/386665a7d3c54590817d6a4be1522be7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:23.300629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.302622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:23.352782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1053/2106] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:23 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:23.357391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5354c-71d2-4ce4-aaa1-334765622fb6 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.358965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6bd5354c-71d2-4ce4-aaa1-334765622fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:23.392921 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4aec4-d03f-45cd-b57d-415fabb25b05 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:23.406691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:23.407609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:23.407894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:23.408168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] PATH_INFO: `/v3/users/621727917c4c45be8b303b991bb3bbe5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:23.409698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621727917c4c45be8b303b991bb3bbe5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:23.411924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:23.454495 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5354c-71d2-4ce4-aaa1-334765622fb6 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:23.461897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a7846-201f-4848-82aa-88e1d0fe8c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:23.462816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a7846-201f-4848-82aa-88e1d0fe8c14 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:23.463105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a7846-201f-4848-82aa-88e1d0fe8c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:23.463499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a7846-201f-4848-82aa-88e1d0fe8c14 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:23.464265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a7846-201f-4848-82aa-88e1d0fe8c14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:23.466487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a7846-201f-4848-82aa-88e1d0fe8c14 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:23.477525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621727917c4c45be8b303b991bb3bbe5'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.505342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621727917c4c45be8b303b991bb3bbe5'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.510594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1054/2107] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:23 2021] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:23.513796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a7846-201f-4848-82aa-88e1d0fe8c14 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.515910 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-383a7846-201f-4848-82aa-88e1d0fe8c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:23.516684 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621727917c4c45be8b303b991bb3bbe5'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.527932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621727917c4c45be8b303b991bb3bbe5'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.529023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621727917c4c45be8b303b991bb3bbe5'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.536102 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1054/2108] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:23 2021] DELETE /identity/v3/users/621727917c4c45be8b303b991bb3bbe5 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:23.537451 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.539034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:23.612549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a7846-201f-4848-82aa-88e1d0fe8c14 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:23.621069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a342d6e2-0aba-44f8-82bc-365a11beae05 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:23.622494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:23.623746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:23.624157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:23.624537 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] PATH_INFO: `/v3/projects/e67e3c5df95b4bb0898998d2724c1a2a` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:23.626382 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e67e3c5df95b4bb0898998d2724c1a2a)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:23.626826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecee1f-2efc-47be-8712-815703577c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:23.627997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecee1f-2efc-47be-8712-815703577c31 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:23.628345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecee1f-2efc-47be-8712-815703577c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:23.628652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecee1f-2efc-47be-8712-815703577c31 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:23.629392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecee1f-2efc-47be-8712-815703577c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:23.630679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:23.631630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecee1f-2efc-47be-8712-815703577c31 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:23.661392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1055/2109] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:23 2021] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:23.664006 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecee1f-2efc-47be-8712-815703577c31 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.674246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecee1f-2efc-47be-8712-815703577c31 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:23.680211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5a50c-94da-434a-ac42-f9ed8310d799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:23.680966 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5a50c-94da-434a-ac42-f9ed8310d799 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:23.681245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5a50c-94da-434a-ac42-f9ed8310d799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:23.681741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5a50c-94da-434a-ac42-f9ed8310d799 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:23.682512 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5a50c-94da-434a-ac42-f9ed8310d799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:23.684242 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5a50c-94da-434a-ac42-f9ed8310d799 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:23.695715 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e67e3c5df95b4bb0898998d2724c1a2a', 'request_id': 'req-d1917c5d-a85c-4150-a78b-275c9d075a26'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.701051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1056/2110] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:23 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:23.705880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e67e3c5df95b4bb0898998d2724c1a2a', 'request_id': 'req-d1917c5d-a85c-4150-a78b-275c9d075a26'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.706315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5a50c-94da-434a-ac42-f9ed8310d799 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.713626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e67e3c5df95b4bb0898998d2724c1a2a', 'request_id': 'req-d1917c5d-a85c-4150-a78b-275c9d075a26'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.719999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5a50c-94da-434a-ac42-f9ed8310d799 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:23.724760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] The token cache is being invalidate because project e67e3c5df95b4bb0898998d2724c1a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:23.725050 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.725786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.727859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1055/2111] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:23 2021] DELETE /identity/v3/projects/e67e3c5df95b4bb0898998d2724c1a2a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:23.731654 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.733604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:23.786146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424ec84-2818-48c6-ba93-9f0eae60347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:23.787207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424ec84-2818-48c6-ba93-9f0eae60347e admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:23.787502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424ec84-2818-48c6-ba93-9f0eae60347e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:23.787778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424ec84-2818-48c6-ba93-9f0eae60347e admin admin] PATH_INFO: `/v3/projects/6598b4cbd80d480ca76cf12e3a34bdf5/users/ea8cb0884c01487ab7496b670bc4c43b/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:23.811958 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424ec84-2818-48c6-ba93-9f0eae60347e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6598b4cbd80d480ca76cf12e3a34bdf5, user_id=ea8cb0884c01487ab7496b670bc4c43b, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:23.813976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1917c5d-a85c-4150-a78b-275c9d075a26 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:23.815098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424ec84-2818-48c6-ba93-9f0eae60347e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:23.821689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:23.821689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:23.822030 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:23.822308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] PATH_INFO: `/v3/users/17713d68d1274691bcc3af7b2e433fd2` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:23.823879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=17713d68d1274691bcc3af7b2e433fd2)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:23.826627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:23.833182 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1057/2112] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:23 2021] PUT /identity/v3/projects/6598b4cbd80d480ca76cf12e3a34bdf5/users/ea8cb0884c01487ab7496b670bc4c43b/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:23.837214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424ec84-2818-48c6-ba93-9f0eae60347e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.838965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-5424ec84-2818-48c6-ba93-9f0eae60347e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:23.891090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17713d68d1274691bcc3af7b2e433fd2'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.906693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17713d68d1274691bcc3af7b2e433fd2'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.907811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17713d68d1274691bcc3af7b2e433fd2'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.922964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17713d68d1274691bcc3af7b2e433fd2'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.935266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17713d68d1274691bcc3af7b2e433fd2'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:23.939519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424ec84-2818-48c6-ba93-9f0eae60347e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:23.944702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1056/2113] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:23 2021] DELETE /identity/v3/users/17713d68d1274691bcc3af7b2e433fd2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:23.945985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:23.947796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.039797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f3f74-b2ca-4d6e-94bb-e6cb81bf3241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:24.040670 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3f74-b2ca-4d6e-94bb-e6cb81bf3241 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.041026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3f74-b2ca-4d6e-94bb-e6cb81bf3241 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.042128 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2f3f74-b2ca-4d6e-94bb-e6cb81bf3241 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.043365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f3f74-b2ca-4d6e-94bb-e6cb81bf3241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:24.046045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2f3f74-b2ca-4d6e-94bb-e6cb81bf3241 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:24.087120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1058/2114] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:23 2021] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:24.087306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8ce15-23dc-4fb3-b07d-d4c6c33b19eb admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:24.093010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f3f74-b2ca-4d6e-94bb-e6cb81bf3241 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:24.096003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1b2f3f74-b2ca-4d6e-94bb-e6cb81bf3241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.100547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:24.102528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.104446 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.105088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] PATH_INFO: `/v3/projects/ff06c30d0e07461fb183e0fb7df43276` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.107496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff06c30d0e07461fb183e0fb7df43276)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:24.113033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:24.122106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2f3f74-b2ca-4d6e-94bb-e6cb81bf3241 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:24.129703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852bd0d-0070-4f9f-bdda-e00ac624318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:24.130835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852bd0d-0070-4f9f-bdda-e00ac624318e admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.131340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852bd0d-0070-4f9f-bdda-e00ac624318e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.131804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852bd0d-0070-4f9f-bdda-e00ac624318e admin admin] PATH_INFO: `/v3/projects/6598b4cbd80d480ca76cf12e3a34bdf5/users/ea8cb0884c01487ab7496b670bc4c43b/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.135571 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852bd0d-0070-4f9f-bdda-e00ac624318e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6598b4cbd80d480ca76cf12e3a34bdf5, user_id=ea8cb0884c01487ab7496b670bc4c43b, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:24.139057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852bd0d-0070-4f9f-bdda-e00ac624318e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:24.159269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1059/2115] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:24 2021] PUT /identity/v3/projects/6598b4cbd80d480ca76cf12e3a34bdf5/users/ea8cb0884c01487ab7496b670bc4c43b/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:24.172412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdf477-a26c-47ab-b3a2-e08bd297f80d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.172412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdf477-a26c-47ab-b3a2-e08bd297f80d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.172708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdf477-a26c-47ab-b3a2-e08bd297f80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.207929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-a0fdf477-a26c-47ab-b3a2-e08bd297f80d None None] MFA Rules not processed for user `ea8cb0884c01487ab7496b670bc4c43b`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:24.209327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a0fdf477-a26c-47ab-b3a2-e08bd297f80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.232093 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff06c30d0e07461fb183e0fb7df43276', 'request_id': 'req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.240689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff06c30d0e07461fb183e0fb7df43276', 'request_id': 'req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.247948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff06c30d0e07461fb183e0fb7df43276', 'request_id': 'req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.258746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] The token cache is being invalidate because project ff06c30d0e07461fb183e0fb7df43276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:24.258947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.259626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-36cd2669-83a5-4b0f-9aa8-948144e2cf8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.261644 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1057/2116] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:23 2021] DELETE /identity/v3/projects/ff06c30d0e07461fb183e0fb7df43276 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:24.271482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826c961-f8ef-4b33-b645-4e8b92c733c7 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.271812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826c961-f8ef-4b33-b645-4e8b92c733c7 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.272058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f826c961-f8ef-4b33-b645-4e8b92c733c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.291572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-f826c961-f8ef-4b33-b645-4e8b92c733c7 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:24.292842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f826c961-f8ef-4b33-b645-4e8b92c733c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.301342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1060/2117] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:24 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:24.312382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdf477-a26c-47ab-b3a2-e08bd297f80d None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:24.313939 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a0fdf477-a26c-47ab-b3a2-e08bd297f80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.411398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1058/2118] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:24.414768 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdf477-a26c-47ab-b3a2-e08bd297f80d None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:24.419197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f345-8b03-4101-9c00-5d8b38acead2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:24.419836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826c961-f8ef-4b33-b645-4e8b92c733c7 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:24.419965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f345-8b03-4101-9c00-5d8b38acead2 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.420143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f345-8b03-4101-9c00-5d8b38acead2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.420391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f345-8b03-4101-9c00-5d8b38acead2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.421222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f826c961-f8ef-4b33-b645-4e8b92c733c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.422502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6624f345-8b03-4101-9c00-5d8b38acead2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.435304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f826c961-f8ef-4b33-b645-4e8b92c733c7 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:24.445240 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:24.446770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.447119 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.447569 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] PATH_INFO: `/v3/projects/9d6bd39178514feeb27919eb56d61820` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.449679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6bd39178514feeb27919eb56d61820)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:24.451560 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:24.495856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624f345-8b03-4101-9c00-5d8b38acead2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:24.497717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624f345-8b03-4101-9c00-5d8b38acead2 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:24.510127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1061/2119] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:24 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:24.511359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f345-8b03-4101-9c00-5d8b38acead2 service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:24.513392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6624f345-8b03-4101-9c00-5d8b38acead2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.513828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6bd39178514feeb27919eb56d61820', 'request_id': 'req-ac929dab-d66e-48b9-bcc1-5f1599c888c2'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.532093 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6bd39178514feeb27919eb56d61820', 'request_id': 'req-ac929dab-d66e-48b9-bcc1-5f1599c888c2'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.536879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f345-8b03-4101-9c00-5d8b38acead2 service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:24.545982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6bd39178514feeb27919eb56d61820', 'request_id': 'req-ac929dab-d66e-48b9-bcc1-5f1599c888c2'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.562738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] The token cache is being invalidate because project 9d6bd39178514feeb27919eb56d61820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:24.563297 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.564342 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ac929dab-d66e-48b9-bcc1-5f1599c888c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.567212 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1059/2120] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:24 2021] DELETE /identity/v3/projects/9d6bd39178514feeb27919eb56d61820 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:24.569794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c437f-1645-4cb5-b701-db326c63558a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.570293 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c437f-1645-4cb5-b701-db326c63558a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.570876 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c437f-1645-4cb5-b701-db326c63558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.600781 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:24.601260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-fa4c437f-1645-4cb5-b701-db326c63558a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:24.601850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.602239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.602568 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] PATH_INFO: `/v3/users/6a7120050c8243099de6e207b112b5b4` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.603455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fa4c437f-1645-4cb5-b701-db326c63558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.604099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7120050c8243099de6e207b112b5b4)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:24.606933 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:24.620691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1060/2121] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:24.620691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d686cb-15cd-4764-9766-96ffa46e1d98 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.620691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d686cb-15cd-4764-9766-96ffa46e1d98 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.620691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d686cb-15cd-4764-9766-96ffa46e1d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.649307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-42d686cb-15cd-4764-9766-96ffa46e1d98 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:24.651317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-42d686cb-15cd-4764-9766-96ffa46e1d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.665903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1061/2122] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:24.667210 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d686cb-15cd-4764-9766-96ffa46e1d98 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:24.669381 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7120050c8243099de6e207b112b5b4'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.680135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d686cb-15cd-4764-9766-96ffa46e1d98 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:24.685620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7120050c8243099de6e207b112b5b4'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.686192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3a285-030d-487c-9f35-af8d6b2bfa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:24.686781 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a285-030d-487c-9f35-af8d6b2bfa54 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.687147 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a285-030d-487c-9f35-af8d6b2bfa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.687483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3a285-030d-487c-9f35-af8d6b2bfa54 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.688126 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3a285-030d-487c-9f35-af8d6b2bfa54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:24.688424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3a285-030d-487c-9f35-af8d6b2bfa54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:24.690497 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3a285-030d-487c-9f35-af8d6b2bfa54 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:24.697552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7120050c8243099de6e207b112b5b4'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.706417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7120050c8243099de6e207b112b5b4'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.707119 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7120050c8243099de6e207b112b5b4'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:24.707666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1062/2123] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:24.713947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1062/2124] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:24 2021] DELETE /identity/v3/users/6a7120050c8243099de6e207b112b5b4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:24.714225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a31e1e-ffd1-4357-8d2c-5e343c838d2e None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.714522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a31e1e-ffd1-4357-8d2c-5e343c838d2e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.714819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a31e1e-ffd1-4357-8d2c-5e343c838d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.719705 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:24.726233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.736564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c2a31e1e-ffd1-4357-8d2c-5e343c838d2e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:24.738002 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c2a31e1e-ffd1-4357-8d2c-5e343c838d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.804285 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa614ab-2de4-4131-a1d9-0e6cfbfd741f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:24.811255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c82c-b952-49e2-b83e-521c0e7df9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:24.812183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c82c-b952-49e2-b83e-521c0e7df9db admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.812658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c82c-b952-49e2-b83e-521c0e7df9db admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.812934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5c82c-b952-49e2-b83e-521c0e7df9db admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.813649 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c82c-b952-49e2-b83e-521c0e7df9db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:24.815836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5c82c-b952-49e2-b83e-521c0e7df9db admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:24.822925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1063/2125] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:24.834752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fc57b-ef4a-4dd4-93be-8999f85894da None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.837465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fc57b-ef4a-4dd4-93be-8999f85894da None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.837856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468fc57b-ef4a-4dd4-93be-8999f85894da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.863005 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1063/2126] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:24 2021] POST /identity/v3/projects => generated 385 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:24.863005 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c82c-b952-49e2-b83e-521c0e7df9db admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:24.883443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-468fc57b-ef4a-4dd4-93be-8999f85894da None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:24.885010 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-468fc57b-ef4a-4dd4-93be-8999f85894da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.961782 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5c82c-b952-49e2-b83e-521c0e7df9db admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:24.968182 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280c837-c7a8-42f7-a62a-2bc44743fae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:24.968898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280c837-c7a8-42f7-a62a-2bc44743fae7 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.969180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280c837-c7a8-42f7-a62a-2bc44743fae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.969452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280c837-c7a8-42f7-a62a-2bc44743fae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.969890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1064/2127] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:24.970410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280c837-c7a8-42f7-a62a-2bc44743fae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:24.970702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280c837-c7a8-42f7-a62a-2bc44743fae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:24.971806 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fc57b-ef4a-4dd4-93be-8999f85894da None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:24.972521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280c837-c7a8-42f7-a62a-2bc44743fae7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:24.984460 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468fc57b-ef4a-4dd4-93be-8999f85894da None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:24.988865 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1064/2128] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:24.988865 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280c837-c7a8-42f7-a62a-2bc44743fae7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:24.991142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-3280c837-c7a8-42f7-a62a-2bc44743fae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:24.993592 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e8c27-9afe-4654-8646-ad81537fe73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:24.994421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e8c27-9afe-4654-8646-ad81537fe73e admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:24.994766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e8c27-9afe-4654-8646-ad81537fe73e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:24.994981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e8c27-9afe-4654-8646-ad81537fe73e admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:24.995793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e8c27-9afe-4654-8646-ad81537fe73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:24.997985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e8c27-9afe-4654-8646-ad81537fe73e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.028777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1065/2129] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:24 2021] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:25.028777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e8c27-9afe-4654-8646-ad81537fe73e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.043506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e8c27-9afe-4654-8646-ad81537fe73e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.048818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65813e8-28d6-4bdf-b36b-3374cb774189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:25.049626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65813e8-28d6-4bdf-b36b-3374cb774189 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.049991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65813e8-28d6-4bdf-b36b-3374cb774189 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.050413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65813e8-28d6-4bdf-b36b-3374cb774189 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.051131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65813e8-28d6-4bdf-b36b-3374cb774189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:25.053295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65813e8-28d6-4bdf-b36b-3374cb774189 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.061444 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280c837-c7a8-42f7-a62a-2bc44743fae7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.068143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24367a3d-b632-47a7-9880-3ccec3884a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:25.068857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367a3d-b632-47a7-9880-3ccec3884a18 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.069141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367a3d-b632-47a7-9880-3ccec3884a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.069411 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24367a3d-b632-47a7-9880-3ccec3884a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.081153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24367a3d-b632-47a7-9880-3ccec3884a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:25.083293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24367a3d-b632-47a7-9880-3ccec3884a18 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.089880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1066/2130] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:25 2021] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:25.089880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65813e8-28d6-4bdf-b36b-3374cb774189 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.094130 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1065/2131] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:25.095064 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24367a3d-b632-47a7-9880-3ccec3884a18 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.106064 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24367a3d-b632-47a7-9880-3ccec3884a18 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.174472 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65813e8-28d6-4bdf-b36b-3374cb774189 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.181865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c4bcc-577b-41d5-82ca-6004387b0026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:25.182944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c4bcc-577b-41d5-82ca-6004387b0026 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.183735 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c4bcc-577b-41d5-82ca-6004387b0026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.184016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c4bcc-577b-41d5-82ca-6004387b0026 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.184138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8658412-6db9-475f-9635-de53faafcdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:25.184963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658412-6db9-475f-9635-de53faafcdeb admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.185329 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c4bcc-577b-41d5-82ca-6004387b0026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:25.185428 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658412-6db9-475f-9635-de53faafcdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.185705 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8658412-6db9-475f-9635-de53faafcdeb admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.186668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8658412-6db9-475f-9635-de53faafcdeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:25.187054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c4bcc-577b-41d5-82ca-6004387b0026 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.189445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8658412-6db9-475f-9635-de53faafcdeb admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.204504 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1067/2132] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:25 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:25.206289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c4bcc-577b-41d5-82ca-6004387b0026 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.219515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c4bcc-577b-41d5-82ca-6004387b0026 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.220031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1066/2133] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:25 2021] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:25.224793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8658412-6db9-475f-9635-de53faafcdeb admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.227634 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3710fa6-9acd-4990-bab1-f1663fdcd378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:25.228311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3710fa6-9acd-4990-bab1-f1663fdcd378 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.228605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3710fa6-9acd-4990-bab1-f1663fdcd378 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.228903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3710fa6-9acd-4990-bab1-f1663fdcd378 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.229716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3710fa6-9acd-4990-bab1-f1663fdcd378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:25.241114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8658412-6db9-475f-9635-de53faafcdeb admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.242322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3710fa6-9acd-4990-bab1-f1663fdcd378 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.249332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27065a-7d3a-40e8-894a-d5229d883a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:25.250808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27065a-7d3a-40e8-894a-d5229d883a69 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.251416 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27065a-7d3a-40e8-894a-d5229d883a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.252758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27065a-7d3a-40e8-894a-d5229d883a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.254065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27065a-7d3a-40e8-894a-d5229d883a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:25.256938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27065a-7d3a-40e8-894a-d5229d883a69 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.265557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1068/2134] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:25 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:25.271602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3710fa6-9acd-4990-bab1-f1663fdcd378 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.279955 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1067/2135] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:25 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:25.281106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27065a-7d3a-40e8-894a-d5229d883a69 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.289918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3710fa6-9acd-4990-bab1-f1663fdcd378 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.299839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27065a-7d3a-40e8-894a-d5229d883a69 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.306049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b1286-2bef-4583-a945-25dd5e6ff83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:25.306960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b1286-2bef-4583-a945-25dd5e6ff83b admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.307245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b1286-2bef-4583-a945-25dd5e6ff83b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.308187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b1286-2bef-4583-a945-25dd5e6ff83b admin admin] PATH_INFO: `/v3/projects/0bad9ca445ff4fc38e3bd3007f4aa262/users/c64a6d870a2740b9a74ffb6b14a84a41/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.312109 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea880438-7e9c-46ab-a554-4d408260a1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:25.313362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea880438-7e9c-46ab-a554-4d408260a1bd admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.314050 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea880438-7e9c-46ab-a554-4d408260a1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.314525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea880438-7e9c-46ab-a554-4d408260a1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.315976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea880438-7e9c-46ab-a554-4d408260a1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:25.318982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea880438-7e9c-46ab-a554-4d408260a1bd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.333050 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b1286-2bef-4583-a945-25dd5e6ff83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bad9ca445ff4fc38e3bd3007f4aa262, user_id=c64a6d870a2740b9a74ffb6b14a84a41, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:25.338836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b1286-2bef-4583-a945-25dd5e6ff83b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.340132 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1068/2136] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:25 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:25.341262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea880438-7e9c-46ab-a554-4d408260a1bd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.357072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea880438-7e9c-46ab-a554-4d408260a1bd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.367597 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1069/2137] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:25 2021] PUT /identity/v3/projects/0bad9ca445ff4fc38e3bd3007f4aa262/users/c64a6d870a2740b9a74ffb6b14a84a41/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:25.375182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd325a-f566-4c95-a280-a24df56e8bf1 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.375514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd325a-f566-4c95-a280-a24df56e8bf1 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.375801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd325a-f566-4c95-a280-a24df56e8bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.428181 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7dcd325a-f566-4c95-a280-a24df56e8bf1 None None] MFA Rules not processed for user `c64a6d870a2740b9a74ffb6b14a84a41`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:25.429646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7dcd325a-f566-4c95-a280-a24df56e8bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:25.432067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca6f2e-ffa7-4d6f-a33a-981240045b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:25.433356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca6f2e-ffa7-4d6f-a33a-981240045b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.433735 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca6f2e-ffa7-4d6f-a33a-981240045b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.434178 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca6f2e-ffa7-4d6f-a33a-981240045b70 admin admin] PATH_INFO: `/v3/projects/1f403b1039c14150a1b4eac4f87b3734/users/9be25ceb16b54c58b64693a6c6f63855/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.454181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca6f2e-ffa7-4d6f-a33a-981240045b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f403b1039c14150a1b4eac4f87b3734, user_id=9be25ceb16b54c58b64693a6c6f63855, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:25.459385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca6f2e-ffa7-4d6f-a33a-981240045b70 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.478742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1069/2138] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:25 2021] PUT /identity/v3/projects/1f403b1039c14150a1b4eac4f87b3734/users/9be25ceb16b54c58b64693a6c6f63855/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:25.491147 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c866-6dc8-47c1-819a-cbfdeda90b95 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.491429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c866-6dc8-47c1-819a-cbfdeda90b95 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.492101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c866-6dc8-47c1-819a-cbfdeda90b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.515607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1070/2139] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:25 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:25.523358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-99f4c866-6dc8-47c1-819a-cbfdeda90b95 None None] MFA Rules not processed for user `9be25ceb16b54c58b64693a6c6f63855`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:25.525541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-99f4c866-6dc8-47c1-819a-cbfdeda90b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:25.529912 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd325a-f566-4c95-a280-a24df56e8bf1 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.531305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7dcd325a-f566-4c95-a280-a24df56e8bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:25.653550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd325a-f566-4c95-a280-a24df56e8bf1 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.662548 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1070/2140] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:25 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:25.712273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa5fe-4070-4bfd-9077-8799addf3b57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:25.712972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa5fe-4070-4bfd-9077-8799addf3b57 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.713254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa5fe-4070-4bfd-9077-8799addf3b57 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.713529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafa5fe-4070-4bfd-9077-8799addf3b57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.757567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4c866-6dc8-47c1-819a-cbfdeda90b95 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.759922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-99f4c866-6dc8-47c1-819a-cbfdeda90b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:25.778814 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafa5fe-4070-4bfd-9077-8799addf3b57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:25.780299 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafa5fe-4070-4bfd-9077-8799addf3b57 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.792164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1071/2141] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:25 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:25.812389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa5fe-4070-4bfd-9077-8799addf3b57 service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.833445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4c866-6dc8-47c1-819a-cbfdeda90b95 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.838254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:25.839987 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:25.840281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:25.840622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] PATH_INFO: `/v3/projects/351563e23f2a4ddbbf5abd4ecb8ca98d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:25.841891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=351563e23f2a4ddbbf5abd4ecb8ca98d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:25.843840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:25.895431 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafa5fe-4070-4bfd-9077-8799addf3b57 service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:25.899118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351563e23f2a4ddbbf5abd4ecb8ca98d', 'request_id': 'req-385c9dcf-3e0a-4ea4-9270-10652c657d5b'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:25.918516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351563e23f2a4ddbbf5abd4ecb8ca98d', 'request_id': 'req-385c9dcf-3e0a-4ea4-9270-10652c657d5b'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:25.927061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351563e23f2a4ddbbf5abd4ecb8ca98d', 'request_id': 'req-385c9dcf-3e0a-4ea4-9270-10652c657d5b'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:25.939438 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] The token cache is being invalidate because project 351563e23f2a4ddbbf5abd4ecb8ca98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:25.939806 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:25.940949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:25.943001 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1071/2142] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:25 2021] DELETE /identity/v3/projects/351563e23f2a4ddbbf5abd4ecb8ca98d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:25.943928 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:25.945419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:25.999616 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c05e103-3943-48e6-8056-096329a338cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:26.000531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05e103-3943-48e6-8056-096329a338cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:26.000842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05e103-3943-48e6-8056-096329a338cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:26.001134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c05e103-3943-48e6-8056-096329a338cc admin admin] PATH_INFO: `/v3/users/c64a6d870a2740b9a74ffb6b14a84a41` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:26.004020 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05e103-3943-48e6-8056-096329a338cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c64a6d870a2740b9a74ffb6b14a84a41)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:26.007506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c05e103-3943-48e6-8056-096329a338cc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:26.014351 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c9dcf-3e0a-4ea4-9270-10652c657d5b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:26.019163 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb60be-022a-4dd5-a975-64daa9562464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:26.019846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb60be-022a-4dd5-a975-64daa9562464 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:26.020132 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb60be-022a-4dd5-a975-64daa9562464 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:26.020408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb60be-022a-4dd5-a975-64daa9562464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:26.022641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-88eb60be-022a-4dd5-a975-64daa9562464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:26.077451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-2c05e103-3943-48e6-8056-096329a338cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c64a6d870a2740b9a74ffb6b14a84a41'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.093691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-2c05e103-3943-48e6-8056-096329a338cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c64a6d870a2740b9a74ffb6b14a84a41'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.094693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-2c05e103-3943-48e6-8056-096329a338cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c64a6d870a2740b9a74ffb6b14a84a41'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.102891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb60be-022a-4dd5-a975-64daa9562464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:26.104345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88eb60be-022a-4dd5-a975-64daa9562464 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:26.116021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-2c05e103-3943-48e6-8056-096329a338cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c64a6d870a2740b9a74ffb6b14a84a41'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.118907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1072/2143] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:25 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:26.120014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb60be-022a-4dd5-a975-64daa9562464 service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:26.121797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-88eb60be-022a-4dd5-a975-64daa9562464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:26.128480 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-2c05e103-3943-48e6-8056-096329a338cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c64a6d870a2740b9a74ffb6b14a84a41'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.137153 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1072/2144] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:25 2021] DELETE /identity/v3/users/c64a6d870a2740b9a74ffb6b14a84a41 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:26.141620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f285804-b7fd-4a94-a78a-208e27c03d59 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:26.141906 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f285804-b7fd-4a94-a78a-208e27c03d59 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:26.142183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f285804-b7fd-4a94-a78a-208e27c03d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:26.150101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb60be-022a-4dd5-a975-64daa9562464 service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:26.166048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-5f285804-b7fd-4a94-a78a-208e27c03d59 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:26.167252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5f285804-b7fd-4a94-a78a-208e27c03d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:26.228544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:26.229591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:26.229940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:26.230272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] PATH_INFO: `/v3/users/86085eebcc6c46d490d7dd580e94dad3` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:26.231631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86085eebcc6c46d490d7dd580e94dad3)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:26.234030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:26.240623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1073/2145] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:26.240623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f285804-b7fd-4a94-a78a-208e27c03d59 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:26.240623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5f285804-b7fd-4a94-a78a-208e27c03d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:26.308338 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86085eebcc6c46d490d7dd580e94dad3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.323135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86085eebcc6c46d490d7dd580e94dad3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.331731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f285804-b7fd-4a94-a78a-208e27c03d59 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:26.336619 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86085eebcc6c46d490d7dd580e94dad3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.339964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eea0e-be90-4dac-bfbf-4f783f5fc155 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:26.340895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eea0e-be90-4dac-bfbf-4f783f5fc155 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:26.341259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eea0e-be90-4dac-bfbf-4f783f5fc155 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:26.341593 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eea0e-be90-4dac-bfbf-4f783f5fc155 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:26.343552 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-445eea0e-be90-4dac-bfbf-4f783f5fc155 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:26.348360 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86085eebcc6c46d490d7dd580e94dad3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.349217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86085eebcc6c46d490d7dd580e94dad3'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.366830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1073/2146] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:26 2021] DELETE /identity/v3/users/86085eebcc6c46d490d7dd580e94dad3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:26.366830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:26.374424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:26.410094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445eea0e-be90-4dac-bfbf-4f783f5fc155 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:26.411674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445eea0e-be90-4dac-bfbf-4f783f5fc155 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:26.423993 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1074/2147] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:26 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:26.495666 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5a678-286e-4314-ad31-f6be6d493e06 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:26.508368 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da73dd5-bc78-4371-8189-2c30e3c8e6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:26.509703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da73dd5-bc78-4371-8189-2c30e3c8e6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:26.510162 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da73dd5-bc78-4371-8189-2c30e3c8e6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:26.510441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da73dd5-bc78-4371-8189-2c30e3c8e6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:26.517490 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9da73dd5-bc78-4371-8189-2c30e3c8e6e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:26.571985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eea0e-be90-4dac-bfbf-4f783f5fc155 service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:26.573480 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-445eea0e-be90-4dac-bfbf-4f783f5fc155 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:26.609168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eea0e-be90-4dac-bfbf-4f783f5fc155 service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:26.717130 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:26.718248 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:26.718793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:26.719306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] PATH_INFO: `/v3/users/803c11057e1f46c68b2880064caa059f` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:26.720933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=803c11057e1f46c68b2880064caa059f)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:26.723795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:26.728655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da73dd5-bc78-4371-8189-2c30e3c8e6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:26.730254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da73dd5-bc78-4371-8189-2c30e3c8e6e8 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:26.749602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1074/2148] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:26.793652 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803c11057e1f46c68b2880064caa059f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.806676 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803c11057e1f46c68b2880064caa059f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.807226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803c11057e1f46c68b2880064caa059f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.816203 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803c11057e1f46c68b2880064caa059f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.828043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803c11057e1f46c68b2880064caa059f'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:26.838099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1075/2149] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:26 2021] DELETE /identity/v3/users/803c11057e1f46c68b2880064caa059f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:26.844042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658b12-7249-4fd3-97e1-28a846e18983 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:26.844709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658b12-7249-4fd3-97e1-28a846e18983 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:26.844709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33658b12-7249-4fd3-97e1-28a846e18983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:26.869372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-33658b12-7249-4fd3-97e1-28a846e18983 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:26.870578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-33658b12-7249-4fd3-97e1-28a846e18983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:26.875970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:26.878710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:26.946827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1075/2150] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:26.957228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33658b12-7249-4fd3-97e1-28a846e18983 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:26.960089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-33658b12-7249-4fd3-97e1-28a846e18983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:26.964254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15908df8-eeec-4888-986b-ed811ad256a4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:26.970875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:26.971490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:26.971800 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:26.972081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] PATH_INFO: `/v3/projects/35e676128a8c4a97a415bebb4ff4f1ca` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:26.973451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=35e676128a8c4a97a415bebb4ff4f1ca)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:26.975686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:27.055779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35e676128a8c4a97a415bebb4ff4f1ca', 'request_id': 'req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.056766 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33658b12-7249-4fd3-97e1-28a846e18983 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:27.069656 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35e676128a8c4a97a415bebb4ff4f1ca', 'request_id': 'req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.084032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35e676128a8c4a97a415bebb4ff4f1ca', 'request_id': 'req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.095874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] The token cache is being invalidate because project 35e676128a8c4a97a415bebb4ff4f1ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:27.096202 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.096965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cbd27ce8-ef1a-4b68-af37-67dab51b0e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.099109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1076/2151] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:26 2021] DELETE /identity/v3/projects/35e676128a8c4a97a415bebb4ff4f1ca => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:27.107603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7efec4-f3a5-4fdf-abb5-363a64a130dd None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.108024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7efec4-f3a5-4fdf-abb5-363a64a130dd None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.108374 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7efec4-f3a5-4fdf-abb5-363a64a130dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.132808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-da7efec4-f3a5-4fdf-abb5-363a64a130dd None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:27.134160 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-da7efec4-f3a5-4fdf-abb5-363a64a130dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:27.141396 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad7292-7c4d-404b-a051-65ae8c2e43a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:27.142065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad7292-7c4d-404b-a051-65ae8c2e43a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.142344 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad7292-7c4d-404b-a051-65ae8c2e43a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.142663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad7292-7c4d-404b-a051-65ae8c2e43a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.144831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-edad7292-7c4d-404b-a051-65ae8c2e43a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:27.218312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1077/2152] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:27.219197 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7efec4-f3a5-4fdf-abb5-363a64a130dd None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:27.226794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-da7efec4-f3a5-4fdf-abb5-363a64a130dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:27.241214 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7efec4-f3a5-4fdf-abb5-363a64a130dd None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:27.246957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:27.248348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.248770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.249424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] PATH_INFO: `/v3/projects/0bad9ca445ff4fc38e3bd3007f4aa262` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.251146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bad9ca445ff4fc38e3bd3007f4aa262)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:27.253540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:27.260943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad7292-7c4d-404b-a051-65ae8c2e43a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:27.262620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad7292-7c4d-404b-a051-65ae8c2e43a7 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:27.280295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1076/2153] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:27.281944 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e658-9c1a-4cff-a4fe-7fe14397a0cf None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.282766 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e658-9c1a-4cff-a4fe-7fe14397a0cf None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.283028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e658-9c1a-4cff-a4fe-7fe14397a0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.305585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-cc83e658-9c1a-4cff-a4fe-7fe14397a0cf None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:27.307562 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-cc83e658-9c1a-4cff-a4fe-7fe14397a0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:27.324117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bad9ca445ff4fc38e3bd3007f4aa262', 'request_id': 'req-0b59ab0e-1371-4463-a657-10fe09d85e31'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.345716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bad9ca445ff4fc38e3bd3007f4aa262', 'request_id': 'req-0b59ab0e-1371-4463-a657-10fe09d85e31'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.345716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bad9ca445ff4fc38e3bd3007f4aa262', 'request_id': 'req-0b59ab0e-1371-4463-a657-10fe09d85e31'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.358812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] The token cache is being invalidate because project 0bad9ca445ff4fc38e3bd3007f4aa262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:27.359198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.364428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0b59ab0e-1371-4463-a657-10fe09d85e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.372007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1078/2154] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:27 2021] DELETE /identity/v3/projects/0bad9ca445ff4fc38e3bd3007f4aa262 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:27.373633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697580a-f6f9-468d-becb-18c6b49a53b3 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.373888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697580a-f6f9-468d-becb-18c6b49a53b3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.374187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697580a-f6f9-468d-becb-18c6b49a53b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.400334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-0697580a-f6f9-468d-becb-18c6b49a53b3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:27.401587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0697580a-f6f9-468d-becb-18c6b49a53b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:27.409700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1077/2155] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:27.411054 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e658-9c1a-4cff-a4fe-7fe14397a0cf None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:27.413969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-cc83e658-9c1a-4cff-a4fe-7fe14397a0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:27.415782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1079/2156] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:27.416979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697580a-f6f9-468d-becb-18c6b49a53b3 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:27.428284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697580a-f6f9-468d-becb-18c6b49a53b3 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:27.445006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136285b-d25d-4a19-8431-ef5ae1e95acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:27.446032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136285b-d25d-4a19-8431-ef5ae1e95acf admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.446315 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136285b-d25d-4a19-8431-ef5ae1e95acf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.446737 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136285b-d25d-4a19-8431-ef5ae1e95acf admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.447522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136285b-d25d-4a19-8431-ef5ae1e95acf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:27.448018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136285b-d25d-4a19-8431-ef5ae1e95acf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:27.449721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136285b-d25d-4a19-8431-ef5ae1e95acf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:27.463817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1080/2157] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:27.465776 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2bbca-46e6-4ef0-91fa-919e7619bfd5 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.466255 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2bbca-46e6-4ef0-91fa-919e7619bfd5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.466712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2bbca-46e6-4ef0-91fa-919e7619bfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.488674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-50b2bbca-46e6-4ef0-91fa-919e7619bfd5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:27.490417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-50b2bbca-46e6-4ef0-91fa-919e7619bfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:27.505766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1081/2158] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:27.506878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2bbca-46e6-4ef0-91fa-919e7619bfd5 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:27.521619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2bbca-46e6-4ef0-91fa-919e7619bfd5 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:27.527706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e658-9c1a-4cff-a4fe-7fe14397a0cf None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:27.528893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d13f31-cb4e-4582-9593-16794d1bb05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:27.529899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d13f31-cb4e-4582-9593-16794d1bb05e admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.530326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d13f31-cb4e-4582-9593-16794d1bb05e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.530749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d13f31-cb4e-4582-9593-16794d1bb05e admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.531863 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7f7d-9420-4706-9f00-a32ab5360280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:27.532007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d13f31-cb4e-4582-9593-16794d1bb05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:27.533248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7f7d-9420-4706-9f00-a32ab5360280 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.533549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7f7d-9420-4706-9f00-a32ab5360280 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.533878 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d7f7d-9420-4706-9f00-a32ab5360280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.535136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d13f31-cb4e-4582-9593-16794d1bb05e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:27.536466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6c1d7f7d-9420-4706-9f00-a32ab5360280 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:27.572204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1082/2159] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:27 2021] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:27.572204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d13f31-cb4e-4582-9593-16794d1bb05e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:27.611359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7f7d-9420-4706-9f00-a32ab5360280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:27.613347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d7f7d-9420-4706-9f00-a32ab5360280 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:27.629327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1078/2160] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:27 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:27.643247 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7f7d-9420-4706-9f00-a32ab5360280 service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:27.668229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d13f31-cb4e-4582-9593-16794d1bb05e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:27.677776 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c44e98-70d0-4d2b-83fd-37ea1e16c832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:27.678657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44e98-70d0-4d2b-83fd-37ea1e16c832 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.678943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44e98-70d0-4d2b-83fd-37ea1e16c832 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.679227 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c44e98-70d0-4d2b-83fd-37ea1e16c832 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.679975 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c44e98-70d0-4d2b-83fd-37ea1e16c832 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:27.680283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c44e98-70d0-4d2b-83fd-37ea1e16c832 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:27.688681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c44e98-70d0-4d2b-83fd-37ea1e16c832 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:27.688815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d7f7d-9420-4706-9f00-a32ab5360280 service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:27.708790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97922fb1-5e8f-46db-a7fc-1f441ee78974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:27.709622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922fb1-5e8f-46db-a7fc-1f441ee78974 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.709974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922fb1-5e8f-46db-a7fc-1f441ee78974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.710261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97922fb1-5e8f-46db-a7fc-1f441ee78974 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.711022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97922fb1-5e8f-46db-a7fc-1f441ee78974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:27.713429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1083/2161] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:27.716766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c44e98-70d0-4d2b-83fd-37ea1e16c832 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:27.716766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f4c44e98-70d0-4d2b-83fd-37ea1e16c832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:27.717300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97922fb1-5e8f-46db-a7fc-1f441ee78974 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:27.731301 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c44e98-70d0-4d2b-83fd-37ea1e16c832 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:27.737973 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:27.738869 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.739156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.739509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] PATH_INFO: `/v3/projects/e40e38250ecc457090926506acc084cd` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.742038 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40e38250ecc457090926506acc084cd)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:27.743425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:27.761279 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1079/2162] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:27 2021] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:27.763254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97922fb1-5e8f-46db-a7fc-1f441ee78974 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:27.789710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97922fb1-5e8f-46db-a7fc-1f441ee78974 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:27.795321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac7db2-ec6e-4866-8804-e54600e2806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:27.795996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac7db2-ec6e-4866-8804-e54600e2806a admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.796320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac7db2-ec6e-4866-8804-e54600e2806a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.796622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac7db2-ec6e-4866-8804-e54600e2806a admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.797820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac7db2-ec6e-4866-8804-e54600e2806a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:27.800303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac7db2-ec6e-4866-8804-e54600e2806a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:27.826365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40e38250ecc457090926506acc084cd', 'request_id': 'req-80834904-2275-43f5-9a50-711f22a84038'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.841482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1080/2163] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:27 2021] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:27.841613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40e38250ecc457090926506acc084cd', 'request_id': 'req-80834904-2275-43f5-9a50-711f22a84038'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.842820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac7db2-ec6e-4866-8804-e54600e2806a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:27.854381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40e38250ecc457090926506acc084cd', 'request_id': 'req-80834904-2275-43f5-9a50-711f22a84038'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.882860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] The token cache is being invalidate because project e40e38250ecc457090926506acc084cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:27.883174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.884336 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:27.886090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1084/2164] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:27 2021] DELETE /identity/v3/projects/e40e38250ecc457090926506acc084cd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:27.889609 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:27.892769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:27.938790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac7db2-ec6e-4866-8804-e54600e2806a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:27.950215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd78917-5541-4881-9d1b-99d70227a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:27.951083 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd78917-5541-4881-9d1b-99d70227a145 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:27.951435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd78917-5541-4881-9d1b-99d70227a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:27.951846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd78917-5541-4881-9d1b-99d70227a145 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:27.952736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd78917-5541-4881-9d1b-99d70227a145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:27.954944 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd78917-5541-4881-9d1b-99d70227a145 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:27.971826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1081/2165] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:27 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:27.971826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd78917-5541-4881-9d1b-99d70227a145 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:27.978741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ccd78917-5541-4881-9d1b-99d70227a145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:28.016949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd78917-5541-4881-9d1b-99d70227a145 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:28.041663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:28.046125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.046639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.047108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] PATH_INFO: `/v3/users/fbd9a006440943f786254fdacc7de29d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.048754 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd9a006440943f786254fdacc7de29d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:28.048875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80834904-2275-43f5-9a50-711f22a84038 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:28.053183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:28.054946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115644e8-3acc-4ecd-88e6-8a6b2c1575d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:28.056039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115644e8-3acc-4ecd-88e6-8a6b2c1575d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.056451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115644e8-3acc-4ecd-88e6-8a6b2c1575d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.056871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115644e8-3acc-4ecd-88e6-8a6b2c1575d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.057708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115644e8-3acc-4ecd-88e6-8a6b2c1575d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:28.059963 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115644e8-3acc-4ecd-88e6-8a6b2c1575d9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:28.101300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1085/2166] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:27 2021] POST /identity/v3/users => generated 287 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:28.102581 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115644e8-3acc-4ecd-88e6-8a6b2c1575d9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:28.106418 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-115644e8-3acc-4ecd-88e6-8a6b2c1575d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:28.120716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115644e8-3acc-4ecd-88e6-8a6b2c1575d9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:28.127482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78c341-66a1-4dad-8dd5-f7d46e7010f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:28.128167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c341-66a1-4dad-8dd5-f7d46e7010f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.128541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c341-66a1-4dad-8dd5-f7d46e7010f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.128848 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78c341-66a1-4dad-8dd5-f7d46e7010f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.129614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78c341-66a1-4dad-8dd5-f7d46e7010f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:28.131312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78c341-66a1-4dad-8dd5-f7d46e7010f3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:28.137389 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd9a006440943f786254fdacc7de29d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:28.144010 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1086/2167] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:28 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:28.145399 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78c341-66a1-4dad-8dd5-f7d46e7010f3 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:28.162274 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78c341-66a1-4dad-8dd5-f7d46e7010f3 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:28.167197 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0659aed-fd96-457a-a370-64b29e93709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:28.168235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0659aed-fd96-457a-a370-64b29e93709f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.168820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0659aed-fd96-457a-a370-64b29e93709f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.168820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0659aed-fd96-457a-a370-64b29e93709f admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.170157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0659aed-fd96-457a-a370-64b29e93709f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:28.171762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0659aed-fd96-457a-a370-64b29e93709f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:28.176448 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd9a006440943f786254fdacc7de29d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:28.189651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1087/2168] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:28 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:28.190685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0659aed-fd96-457a-a370-64b29e93709f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:28.197373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd9a006440943f786254fdacc7de29d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:28.202659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0659aed-fd96-457a-a370-64b29e93709f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:28.208208 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aa19c-1c97-4daa-8afc-5744ca86fef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:28.209295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa19c-1c97-4daa-8afc-5744ca86fef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.209645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa19c-1c97-4daa-8afc-5744ca86fef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.210020 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa19c-1c97-4daa-8afc-5744ca86fef3 admin admin] PATH_INFO: `/v3/projects/35dc54b1bebe4180847d1d0b6894612b/users/77a5d763d2d848f58fe4f483ad724bd7/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.213032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd9a006440943f786254fdacc7de29d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:28.213947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd9a006440943f786254fdacc7de29d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:28.223151 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1082/2169] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:27 2021] DELETE /identity/v3/users/fbd9a006440943f786254fdacc7de29d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:28.228429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:28.228794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aa19c-1c97-4daa-8afc-5744ca86fef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35dc54b1bebe4180847d1d0b6894612b, user_id=77a5d763d2d848f58fe4f483ad724bd7, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:28.228953 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:28.229423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aa19c-1c97-4daa-8afc-5744ca86fef3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:28.249166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1088/2170] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:28 2021] PUT /identity/v3/projects/35dc54b1bebe4180847d1d0b6894612b/users/77a5d763d2d848f58fe4f483ad724bd7/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:28.257007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796bce6-1c5d-4e22-a237-0ce6392831f5 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.257291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796bce6-1c5d-4e22-a237-0ce6392831f5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.257562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796bce6-1c5d-4e22-a237-0ce6392831f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.281080 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9796bce6-1c5d-4e22-a237-0ce6392831f5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:28.282387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9796bce6-1c5d-4e22-a237-0ce6392831f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:28.367895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e8e1ac-a4e3-4c52-a8d5-999190761137 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:28.388926 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1089/2171] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:28.396172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796bce6-1c5d-4e22-a237-0ce6392831f5 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:28.399782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9796bce6-1c5d-4e22-a237-0ce6392831f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:28.487124 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10270d-336a-456f-a6bb-f4ef4b9c1240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:28.487910 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10270d-336a-456f-a6bb-f4ef4b9c1240 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.488192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10270d-336a-456f-a6bb-f4ef4b9c1240 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.488502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10270d-336a-456f-a6bb-f4ef4b9c1240 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.489519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10270d-336a-456f-a6bb-f4ef4b9c1240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:28.491748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10270d-336a-456f-a6bb-f4ef4b9c1240 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:28.504630 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796bce6-1c5d-4e22-a237-0ce6392831f5 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:28.508970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1083/2172] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:28 2021] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:28.513919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10270d-336a-456f-a6bb-f4ef4b9c1240 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:28.521518 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb919d75-567c-4609-9b90-17a2808aa162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:28.522564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb919d75-567c-4609-9b90-17a2808aa162 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.523008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb919d75-567c-4609-9b90-17a2808aa162 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.523430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb919d75-567c-4609-9b90-17a2808aa162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.526409 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10270d-336a-456f-a6bb-f4ef4b9c1240 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:28.531215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef893730-101e-4030-921b-a49b50052a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:28.532603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef893730-101e-4030-921b-a49b50052a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.532603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef893730-101e-4030-921b-a49b50052a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.532810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef893730-101e-4030-921b-a49b50052a3e admin admin] PATH_INFO: `/v3/projects/49376457b7184f718e3fb3c7c8bc560c/users/022dd83f39da46c9a32595f797bd02dd/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.535305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb919d75-567c-4609-9b90-17a2808aa162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:28.537077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb919d75-567c-4609-9b90-17a2808aa162 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:28.549177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1090/2173] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:28.556340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef893730-101e-4030-921b-a49b50052a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49376457b7184f718e3fb3c7c8bc560c, user_id=022dd83f39da46c9a32595f797bd02dd, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:28.559361 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef893730-101e-4030-921b-a49b50052a3e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:28.577171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1084/2174] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:28 2021] PUT /identity/v3/projects/49376457b7184f718e3fb3c7c8bc560c/users/022dd83f39da46c9a32595f797bd02dd/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:28.591779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c97cb-15ff-425f-a73b-a3f352bee84e None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.593893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c97cb-15ff-425f-a73b-a3f352bee84e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.594299 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c97cb-15ff-425f-a73b-a3f352bee84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.626965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-866c97cb-15ff-425f-a73b-a3f352bee84e None None] MFA Rules not processed for user `022dd83f39da46c9a32595f797bd02dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:28.628379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-866c97cb-15ff-425f-a73b-a3f352bee84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:28.633621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef893730-101e-4030-921b-a49b50052a3e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:28.635706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ef893730-101e-4030-921b-a49b50052a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:28.714092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1091/2175] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:28 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:28.718294 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c97cb-15ff-425f-a73b-a3f352bee84e None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:28.737750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef893730-101e-4030-921b-a49b50052a3e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:28.744215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:28.745329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.745948 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.746768 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] PATH_INFO: `/v3/projects/a358501c0c6f41d8a3f372ab8a051d73` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.748264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a358501c0c6f41d8a3f372ab8a051d73)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:28.750916 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:28.792983 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c97cb-15ff-425f-a73b-a3f352bee84e None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:28.797776 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c56855-4baa-4069-bbba-a361b881c687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:28.798450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c56855-4baa-4069-bbba-a361b881c687 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.798719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c56855-4baa-4069-bbba-a361b881c687 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.799271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c56855-4baa-4069-bbba-a361b881c687 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.800191 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c56855-4baa-4069-bbba-a361b881c687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:28.802270 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c56855-4baa-4069-bbba-a361b881c687 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:28.812625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a358501c0c6f41d8a3f372ab8a051d73', 'request_id': 'req-3571bd3d-186d-4cda-915a-3494bed08f97'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:28.822851 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a358501c0c6f41d8a3f372ab8a051d73', 'request_id': 'req-3571bd3d-186d-4cda-915a-3494bed08f97'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:28.830721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a358501c0c6f41d8a3f372ab8a051d73', 'request_id': 'req-3571bd3d-186d-4cda-915a-3494bed08f97'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:28.834006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1092/2176] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:28 2021] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:28.838984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c56855-4baa-4069-bbba-a361b881c687 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:28.842797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] The token cache is being invalidate because project a358501c0c6f41d8a3f372ab8a051d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:28.843087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:28.843917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3571bd3d-186d-4cda-915a-3494bed08f97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:28.847864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1085/2177] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:28 2021] DELETE /identity/v3/projects/a358501c0c6f41d8a3f372ab8a051d73 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:28.856252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5de9b-612b-47c9-90a7-e94754298a25 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.856537 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5de9b-612b-47c9-90a7-e94754298a25 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.857179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5de9b-612b-47c9-90a7-e94754298a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.885481 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-32d5de9b-612b-47c9-90a7-e94754298a25 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:28.886986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-32d5de9b-612b-47c9-90a7-e94754298a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:28.946537 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c56855-4baa-4069-bbba-a361b881c687 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:28.958644 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df177a7-afc5-4842-bd8f-a3534ce6c6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:28.960112 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df177a7-afc5-4842-bd8f-a3534ce6c6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:28.960451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df177a7-afc5-4842-bd8f-a3534ce6c6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:28.960997 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df177a7-afc5-4842-bd8f-a3534ce6c6c4 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:28.963229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df177a7-afc5-4842-bd8f-a3534ce6c6c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:28.969209 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df177a7-afc5-4842-bd8f-a3534ce6c6c4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:28.993010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1086/2178] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:29.000907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce730d1-d1ab-4d6f-91ef-c28077afe1ed None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.001214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce730d1-d1ab-4d6f-91ef-c28077afe1ed None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.001462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce730d1-d1ab-4d6f-91ef-c28077afe1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.020086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1093/2179] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:28 2021] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:29.023695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df177a7-afc5-4842-bd8f-a3534ce6c6c4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.028069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-2df177a7-afc5-4842-bd8f-a3534ce6c6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:29.031649 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-2ce730d1-d1ab-4d6f-91ef-c28077afe1ed None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:29.032939 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2ce730d1-d1ab-4d6f-91ef-c28077afe1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:29.044383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df177a7-afc5-4842-bd8f-a3534ce6c6c4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.054073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1087/2180] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:29.057996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c177bf-e19f-466b-aef8-32d115dd8d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.058400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce730d1-d1ab-4d6f-91ef-c28077afe1ed None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.059261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c177bf-e19f-466b-aef8-32d115dd8d64 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.059261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c177bf-e19f-466b-aef8-32d115dd8d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.059992 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c177bf-e19f-466b-aef8-32d115dd8d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.061285 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c177bf-e19f-466b-aef8-32d115dd8d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.063774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c177bf-e19f-466b-aef8-32d115dd8d64 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.077102 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce730d1-d1ab-4d6f-91ef-c28077afe1ed None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.077954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1094/2181] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:29 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:29.082758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c177bf-e19f-466b-aef8-32d115dd8d64 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.087278 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f14e0-2dee-4fc9-add4-b03fd7aac297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.088113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f14e0-2dee-4fc9-add4-b03fd7aac297 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.088455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f14e0-2dee-4fc9-add4-b03fd7aac297 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.088857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f14e0-2dee-4fc9-add4-b03fd7aac297 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.089691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f14e0-2dee-4fc9-add4-b03fd7aac297 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:29.090119 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f14e0-2dee-4fc9-add4-b03fd7aac297 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.092150 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f14e0-2dee-4fc9-add4-b03fd7aac297 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.100795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c177bf-e19f-466b-aef8-32d115dd8d64 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.107868 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc77893-91ae-47ec-bcbc-42a0f4456914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.108898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc77893-91ae-47ec-bcbc-42a0f4456914 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.109205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc77893-91ae-47ec-bcbc-42a0f4456914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.109483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc77893-91ae-47ec-bcbc-42a0f4456914 admin admin] PATH_INFO: `/v3/projects/80900a5c58764e2ea477b3986b59c625/users/9e08f20883084f4694f1df4ff08877ca/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.110328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1088/2182] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:29.115453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f14e0-2dee-4fc9-add4-b03fd7aac297 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.127176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f14e0-2dee-4fc9-add4-b03fd7aac297 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.133045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06feea-9997-42a6-904a-dd29b3d58e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.133526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc77893-91ae-47ec-bcbc-42a0f4456914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80900a5c58764e2ea477b3986b59c625, user_id=9e08f20883084f4694f1df4ff08877ca, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.133712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06feea-9997-42a6-904a-dd29b3d58e42 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.133993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06feea-9997-42a6-904a-dd29b3d58e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.134266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06feea-9997-42a6-904a-dd29b3d58e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.135176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06feea-9997-42a6-904a-dd29b3d58e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.137250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc77893-91ae-47ec-bcbc-42a0f4456914 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.138527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06feea-9997-42a6-904a-dd29b3d58e42 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.165358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1095/2183] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:29 2021] PUT /identity/v3/projects/80900a5c58764e2ea477b3986b59c625/users/9e08f20883084f4694f1df4ff08877ca/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:29.170271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc77893-91ae-47ec-bcbc-42a0f4456914 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.196762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1089/2184] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:29 2021] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:29.198087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06feea-9997-42a6-904a-dd29b3d58e42 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.295301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06feea-9997-42a6-904a-dd29b3d58e42 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.301595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b5746-01a4-46e7-97db-971e43faa488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.302346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b5746-01a4-46e7-97db-971e43faa488 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.302635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b5746-01a4-46e7-97db-971e43faa488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.302917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b5746-01a4-46e7-97db-971e43faa488 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.303640 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b5746-01a4-46e7-97db-971e43faa488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.305834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b5746-01a4-46e7-97db-971e43faa488 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.349005 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1090/2185] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:29 2021] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:29.353276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b5746-01a4-46e7-97db-971e43faa488 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.353454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc77893-91ae-47ec-bcbc-42a0f4456914 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.362359 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4779309-fa0b-4eec-b10a-405067fca4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.363596 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779309-fa0b-4eec-b10a-405067fca4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.363883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779309-fa0b-4eec-b10a-405067fca4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.364233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4779309-fa0b-4eec-b10a-405067fca4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.365229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4779309-fa0b-4eec-b10a-405067fca4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.365530 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b5746-01a4-46e7-97db-971e43faa488 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.369404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4779309-fa0b-4eec-b10a-405067fca4d2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.373357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80610c1c-2fc7-4ae4-b2c2-0776aed53177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.374327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80610c1c-2fc7-4ae4-b2c2-0776aed53177 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.374737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80610c1c-2fc7-4ae4-b2c2-0776aed53177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.375106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80610c1c-2fc7-4ae4-b2c2-0776aed53177 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.376722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80610c1c-2fc7-4ae4-b2c2-0776aed53177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.378925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80610c1c-2fc7-4ae4-b2c2-0776aed53177 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.387304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1096/2186] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:29 2021] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:29.391807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4779309-fa0b-4eec-b10a-405067fca4d2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.393502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1091/2187] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:29 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:29.398098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80610c1c-2fc7-4ae4-b2c2-0776aed53177 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.407940 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4779309-fa0b-4eec-b10a-405067fca4d2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.412886 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80610c1c-2fc7-4ae4-b2c2-0776aed53177 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.422134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e3edd-9178-4630-a437-78cdbb109251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.423520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e3edd-9178-4630-a437-78cdbb109251 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.424420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e3edd-9178-4630-a437-78cdbb109251 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.424420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e3edd-9178-4630-a437-78cdbb109251 admin admin] PATH_INFO: `/v3/projects/80900a5c58764e2ea477b3986b59c625/users/9e08f20883084f4694f1df4ff08877ca/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.427570 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e3edd-9178-4630-a437-78cdbb109251 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80900a5c58764e2ea477b3986b59c625, user_id=9e08f20883084f4694f1df4ff08877ca, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.431929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e3edd-9178-4630-a437-78cdbb109251 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.438721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c47c00-0c1b-4ff7-81f2-e94c3165f371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.440616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c47c00-0c1b-4ff7-81f2-e94c3165f371 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.440921 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c47c00-0c1b-4ff7-81f2-e94c3165f371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.441213 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c47c00-0c1b-4ff7-81f2-e94c3165f371 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.441982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c47c00-0c1b-4ff7-81f2-e94c3165f371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.443622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c47c00-0c1b-4ff7-81f2-e94c3165f371 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.461434 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1092/2188] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:29 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:29.464442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1097/2189] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:29 2021] PUT /identity/v3/projects/80900a5c58764e2ea477b3986b59c625/users/9e08f20883084f4694f1df4ff08877ca/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:29.465296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e3edd-9178-4630-a437-78cdbb109251 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.466511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676658e-edb5-45c8-b1f2-2410f6fc6f79 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.466804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676658e-edb5-45c8-b1f2-2410f6fc6f79 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.467078 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676658e-edb5-45c8-b1f2-2410f6fc6f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.506564 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-b676658e-edb5-45c8-b1f2-2410f6fc6f79 None None] MFA Rules not processed for user `77a5d763d2d848f58fe4f483ad724bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:29.508963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b676658e-edb5-45c8-b1f2-2410f6fc6f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:29.585743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1093/2190] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:29 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:29.586502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e3edd-9178-4630-a437-78cdbb109251 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.587504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270846-4116-48a7-b45f-a30d38399b5d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.587871 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270846-4116-48a7-b45f-a30d38399b5d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.588651 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92270846-4116-48a7-b45f-a30d38399b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.593598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721f279-aa9c-4a79-b557-80932b9b91e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.594904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721f279-aa9c-4a79-b557-80932b9b91e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.595335 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721f279-aa9c-4a79-b557-80932b9b91e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.595806 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721f279-aa9c-4a79-b557-80932b9b91e9 admin admin] PATH_INFO: `/v3/projects/8a8f054a9d1747cf88b9f951a0168f75/users/4ae9604cbb9547619b2154eccd3cfc73/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.621798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721f279-aa9c-4a79-b557-80932b9b91e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8f054a9d1747cf88b9f951a0168f75, user_id=4ae9604cbb9547619b2154eccd3cfc73, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.625188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721f279-aa9c-4a79-b557-80932b9b91e9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.636458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-92270846-4116-48a7-b45f-a30d38399b5d None None] MFA Rules not processed for user `9e08f20883084f4694f1df4ff08877ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:29.637830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-92270846-4116-48a7-b45f-a30d38399b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:29.651305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1098/2191] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:29 2021] PUT /identity/v3/projects/8a8f054a9d1747cf88b9f951a0168f75/users/4ae9604cbb9547619b2154eccd3cfc73/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:29.652204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721f279-aa9c-4a79-b557-80932b9b91e9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.663671 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5721f279-aa9c-4a79-b557-80932b9b91e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:29.770392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721f279-aa9c-4a79-b557-80932b9b91e9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.775527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7066c-b956-41bb-bc95-d2499e8e1bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.776289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7066c-b956-41bb-bc95-d2499e8e1bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.776596 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7066c-b956-41bb-bc95-d2499e8e1bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.776871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7066c-b956-41bb-bc95-d2499e8e1bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.777329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1094/2192] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:29 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:29.778769 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2503-a5b3-4520-8847-c3ddbf65a4a9 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.779284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2503-a5b3-4520-8847-c3ddbf65a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.779680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e2503-a5b3-4520-8847-c3ddbf65a4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.781026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7066c-b956-41bb-bc95-d2499e8e1bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.784464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7066c-b956-41bb-bc95-d2499e8e1bc6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.817556 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1099/2193] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:29 2021] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:29.818862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-921e2503-a5b3-4520-8847-c3ddbf65a4a9 None None] MFA Rules not processed for user `4ae9604cbb9547619b2154eccd3cfc73`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:29.820138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-921e2503-a5b3-4520-8847-c3ddbf65a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:29.821591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7066c-b956-41bb-bc95-d2499e8e1bc6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.823221 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-aeb7066c-b956-41bb-bc95-d2499e8e1bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:29.886230 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7066c-b956-41bb-bc95-d2499e8e1bc6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.891032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534e06b-fe55-4a8c-abe8-2d4ee5fb8b8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.891728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534e06b-fe55-4a8c-abe8-2d4ee5fb8b8b service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.892006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534e06b-fe55-4a8c-abe8-2d4ee5fb8b8b service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.892272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534e06b-fe55-4a8c-abe8-2d4ee5fb8b8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.894293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1095/2194] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:29 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:29.895096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e2503-a5b3-4520-8847-c3ddbf65a4a9 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.899605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3534e06b-fe55-4a8c-abe8-2d4ee5fb8b8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:29.971273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534e06b-fe55-4a8c-abe8-2d4ee5fb8b8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.973106 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534e06b-fe55-4a8c-abe8-2d4ee5fb8b8b service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.974012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e2503-a5b3-4520-8847-c3ddbf65a4a9 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:29.980195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf94fe-3ee3-467e-ab61-c88ea1d3c1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:29.981006 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf94fe-3ee3-467e-ab61-c88ea1d3c1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:29.981367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf94fe-3ee3-467e-ab61-c88ea1d3c1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:29.981691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf94fe-3ee3-467e-ab61-c88ea1d3c1f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:29.982470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf94fe-3ee3-467e-ab61-c88ea1d3c1f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:29.984605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1100/2195] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:29 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:29.984829 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf94fe-3ee3-467e-ab61-c88ea1d3c1f7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:29.985460 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534e06b-fe55-4a8c-abe8-2d4ee5fb8b8b service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:29.987292 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3534e06b-fe55-4a8c-abe8-2d4ee5fb8b8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:30.002283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534e06b-fe55-4a8c-abe8-2d4ee5fb8b8b service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:30.008018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2a2dd-dfe4-4300-bbed-3bb19d0f01a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:30.010024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1096/2196] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:29 2021] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:30.012009 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2a2dd-dfe4-4300-bbed-3bb19d0f01a5 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:30.012009 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2a2dd-dfe4-4300-bbed-3bb19d0f01a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:30.012009 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2a2dd-dfe4-4300-bbed-3bb19d0f01a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:30.023387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf94fe-3ee3-467e-ab61-c88ea1d3c1f7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:30.033933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2a2dd-dfe4-4300-bbed-3bb19d0f01a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:30.035778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2a2dd-dfe4-4300-bbed-3bb19d0f01a5 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:30.042796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf94fe-3ee3-467e-ab61-c88ea1d3c1f7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:30.047992 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1101/2197] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:29 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:30.048613 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6346e-368f-4e51-bd43-5e0ebb81c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:30.048856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2a2dd-dfe4-4300-bbed-3bb19d0f01a5 service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:30.050305 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6346e-368f-4e51-bd43-5e0ebb81c6ae admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:30.050598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6346e-368f-4e51-bd43-5e0ebb81c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:30.050882 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6346e-368f-4e51-bd43-5e0ebb81c6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:30.051457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0af2a2dd-dfe4-4300-bbed-3bb19d0f01a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:30.051638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6346e-368f-4e51-bd43-5e0ebb81c6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:30.053856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6346e-368f-4e51-bd43-5e0ebb81c6ae admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:30.081715 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1097/2198] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:30 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:30.086131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6346e-368f-4e51-bd43-5e0ebb81c6ae admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:30.090709 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2a2dd-dfe4-4300-bbed-3bb19d0f01a5 service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:30.101675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6346e-368f-4e51-bd43-5e0ebb81c6ae admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:30.101987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:30.102794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:30.103075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:30.103350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] PATH_INFO: `/v3/users/d76292ab10394b30bd758ee171574c82` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:30.106991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d76292ab10394b30bd758ee171574c82)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:30.107763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22815a38-5b65-454d-ab16-be22b985aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:30.108997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815a38-5b65-454d-ab16-be22b985aa3c admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:30.109323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815a38-5b65-454d-ab16-be22b985aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:30.109602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22815a38-5b65-454d-ab16-be22b985aa3c admin admin] PATH_INFO: `/v3/projects/5f1c54d0ed6f4fd790c45b416e9910c9/users/ff73929bab914eda8e535e0f82c11de6/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:30.109709 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:30.128912 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22815a38-5b65-454d-ab16-be22b985aa3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1c54d0ed6f4fd790c45b416e9910c9, user_id=ff73929bab914eda8e535e0f82c11de6, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:30.132960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22815a38-5b65-454d-ab16-be22b985aa3c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:30.153806 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1098/2199] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:30 2021] PUT /identity/v3/projects/5f1c54d0ed6f4fd790c45b416e9910c9/users/ff73929bab914eda8e535e0f82c11de6/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:30.159037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22815a38-5b65-454d-ab16-be22b985aa3c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:30.183686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd76292ab10394b30bd758ee171574c82'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:30.199102 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd76292ab10394b30bd758ee171574c82'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:30.200346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd76292ab10394b30bd758ee171574c82'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:30.211128 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd76292ab10394b30bd758ee171574c82'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:30.225666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd76292ab10394b30bd758ee171574c82'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:30.236117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1102/2200] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:30 2021] DELETE /identity/v3/users/d76292ab10394b30bd758ee171574c82 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:30.247205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22815a38-5b65-454d-ab16-be22b985aa3c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:30.374646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989749f-edd1-4744-8b87-00f5b20d0277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:30.375646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989749f-edd1-4744-8b87-00f5b20d0277 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:30.375936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989749f-edd1-4744-8b87-00f5b20d0277 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:30.376196 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989749f-edd1-4744-8b87-00f5b20d0277 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:30.383379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989749f-edd1-4744-8b87-00f5b20d0277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:30.386260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989749f-edd1-4744-8b87-00f5b20d0277 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:30.401478 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1099/2201] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:30 2021] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:30.406166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:30.415960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:30.442447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4cba2-f702-4451-8a4f-0e2aa1880f8b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:30.453606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577fde60-5c7e-4173-970b-615b29b4da2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:30.454766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fde60-5c7e-4173-970b-615b29b4da2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:30.455792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fde60-5c7e-4173-970b-615b29b4da2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:30.456026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fde60-5c7e-4173-970b-615b29b4da2f admin admin] PATH_INFO: `/v3/projects/5f1c54d0ed6f4fd790c45b416e9910c9/users/ff73929bab914eda8e535e0f82c11de6/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:30.464152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fde60-5c7e-4173-970b-615b29b4da2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1c54d0ed6f4fd790c45b416e9910c9, user_id=ff73929bab914eda8e535e0f82c11de6, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:30.467869 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577fde60-5c7e-4173-970b-615b29b4da2f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:30.493648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1103/2202] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:30 2021] PUT /identity/v3/projects/5f1c54d0ed6f4fd790c45b416e9910c9/users/ff73929bab914eda8e535e0f82c11de6/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:30.558563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989749f-edd1-4744-8b87-00f5b20d0277 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:30.564253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-4989749f-edd1-4744-8b87-00f5b20d0277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:30.613692 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989749f-edd1-4744-8b87-00f5b20d0277 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:30.748472 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:30.749605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:30.749897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:30.750166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] PATH_INFO: `/v3/projects/6612774b121e4b92a1e6994061c2f83b` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:30.751476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6612774b121e4b92a1e6994061c2f83b)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:30.753834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:30.871220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6612774b121e4b92a1e6994061c2f83b', 'request_id': 'req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:30.889679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6612774b121e4b92a1e6994061c2f83b', 'request_id': 'req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:30.916722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6612774b121e4b92a1e6994061c2f83b', 'request_id': 'req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:30.923129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] The token cache is being invalidate because project 6612774b121e4b92a1e6994061c2f83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:30.923331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:30.924353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-ceef3f2b-af13-4cf3-bba4-cae96e886e7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:30.934082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1100/2203] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:30 2021] DELETE /identity/v3/projects/6612774b121e4b92a1e6994061c2f83b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:30.937695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a584590-4d2c-419b-b754-567ea0b83c24 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:30.938777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a584590-4d2c-419b-b754-567ea0b83c24 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:30.940642 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a584590-4d2c-419b-b754-567ea0b83c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:30.980093 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-3a584590-4d2c-419b-b754-567ea0b83c24 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:30.983966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3a584590-4d2c-419b-b754-567ea0b83c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:31.130786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1104/2204] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:31.190001 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52772-2b7d-4884-a400-559afa685e28 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:31.191053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52772-2b7d-4884-a400-559afa685e28 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:31.191053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb52772-2b7d-4884-a400-559afa685e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:31.232672 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-8cb52772-2b7d-4884-a400-559afa685e28 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:31.234040 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8cb52772-2b7d-4884-a400-559afa685e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:31.245177 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1101/2205] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:31.251402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a584590-4d2c-419b-b754-567ea0b83c24 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:31.270310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a584590-4d2c-419b-b754-567ea0b83c24 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:31.275780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e41fe-1254-46bc-a743-ca65e20d70a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:31.276756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e41fe-1254-46bc-a743-ca65e20d70a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:31.277062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e41fe-1254-46bc-a743-ca65e20d70a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:31.277354 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e41fe-1254-46bc-a743-ca65e20d70a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:31.278172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e41fe-1254-46bc-a743-ca65e20d70a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:31.278608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e41fe-1254-46bc-a743-ca65e20d70a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:31.280405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e41fe-1254-46bc-a743-ca65e20d70a5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:31.300687 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1105/2206] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:31.308479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb52772-2b7d-4884-a400-559afa685e28 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:31.319551 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb52772-2b7d-4884-a400-559afa685e28 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:31.327835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec007c-873d-40b7-8d30-32f39c07bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:31.328317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec007c-873d-40b7-8d30-32f39c07bf30 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:31.328710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec007c-873d-40b7-8d30-32f39c07bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:31.328940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec007c-873d-40b7-8d30-32f39c07bf30 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:31.329684 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec007c-873d-40b7-8d30-32f39c07bf30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:31.332536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec007c-873d-40b7-8d30-32f39c07bf30 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:31.368975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1102/2207] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:31 2021] POST /identity/v3/projects => generated 393 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:31.374625 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e41fe-1254-46bc-a743-ca65e20d70a5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:31.389083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e41fe-1254-46bc-a743-ca65e20d70a5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:31.474770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916ad0d-f16e-4411-bbaf-4e86237ac7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:31.475471 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916ad0d-f16e-4411-bbaf-4e86237ac7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:31.475747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916ad0d-f16e-4411-bbaf-4e86237ac7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:31.476015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916ad0d-f16e-4411-bbaf-4e86237ac7e7 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:31.476774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916ad0d-f16e-4411-bbaf-4e86237ac7e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:31.478800 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916ad0d-f16e-4411-bbaf-4e86237ac7e7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:31.514024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1106/2208] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:31 2021] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:31.520034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec007c-873d-40b7-8d30-32f39c07bf30 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:31.535332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec007c-873d-40b7-8d30-32f39c07bf30 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:31.545260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e07fbb-586c-4b67-9f42-fd29b42a8006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:31.546358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e07fbb-586c-4b67-9f42-fd29b42a8006 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:31.546590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e07fbb-586c-4b67-9f42-fd29b42a8006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:31.546983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e07fbb-586c-4b67-9f42-fd29b42a8006 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:31.548171 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e07fbb-586c-4b67-9f42-fd29b42a8006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:31.550663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e07fbb-586c-4b67-9f42-fd29b42a8006 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:31.566508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1103/2209] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:31 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:31.576490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916ad0d-f16e-4411-bbaf-4e86237ac7e7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:31.601297 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916ad0d-f16e-4411-bbaf-4e86237ac7e7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:31.607881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294fc50-55cc-4759-b1b4-47071a59de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:31.609047 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294fc50-55cc-4759-b1b4-47071a59de30 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:31.609637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294fc50-55cc-4759-b1b4-47071a59de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:31.610298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3294fc50-55cc-4759-b1b4-47071a59de30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:31.611435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294fc50-55cc-4759-b1b4-47071a59de30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:31.615213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3294fc50-55cc-4759-b1b4-47071a59de30 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:31.626874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dc5d8-cdf2-48e9-ab12-4d4aeb373f9f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:31.627702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dc5d8-cdf2-48e9-ab12-4d4aeb373f9f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:31.628378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dc5d8-cdf2-48e9-ab12-4d4aeb373f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:31.632612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1107/2210] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:31 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:31.637786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294fc50-55cc-4759-b1b4-47071a59de30 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:31.653058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3294fc50-55cc-4759-b1b4-47071a59de30 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:31.664370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-409dc5d8-cdf2-48e9-ab12-4d4aeb373f9f None None] MFA Rules not processed for user `ff73929bab914eda8e535e0f82c11de6`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:31.666097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-409dc5d8-cdf2-48e9-ab12-4d4aeb373f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:31.673535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2984f61-5f4b-44b5-baca-bf247bb9d89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:31.677295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2984f61-5f4b-44b5-baca-bf247bb9d89a admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:31.677850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2984f61-5f4b-44b5-baca-bf247bb9d89a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:31.678131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2984f61-5f4b-44b5-baca-bf247bb9d89a admin admin] PATH_INFO: `/v3/projects/ab0bde5e0af14db49800fbdb92510291/users/17b84b9ba4894db6985fcf9da882f56c/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:31.720313 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2984f61-5f4b-44b5-baca-bf247bb9d89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0bde5e0af14db49800fbdb92510291, user_id=17b84b9ba4894db6985fcf9da882f56c, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:31.726989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2984f61-5f4b-44b5-baca-bf247bb9d89a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:31.751859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1108/2211] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:31 2021] PUT /identity/v3/projects/ab0bde5e0af14db49800fbdb92510291/users/17b84b9ba4894db6985fcf9da882f56c/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:31.759452 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cc26c-0361-4906-8088-d835d3a52faa None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:31.759896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cc26c-0361-4906-8088-d835d3a52faa None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:31.760318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6cc26c-0361-4906-8088-d835d3a52faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:31.793662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-af6cc26c-0361-4906-8088-d835d3a52faa None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:31.800730 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-af6cc26c-0361-4906-8088-d835d3a52faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:31.898397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1104/2212] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:31 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:31.910152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1109/2213] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:31.922402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dc5d8-cdf2-48e9-ab12-4d4aeb373f9f None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:31.924098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-409dc5d8-cdf2-48e9-ab12-4d4aeb373f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:31.925379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cc26c-0361-4906-8088-d835d3a52faa None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:31.928351 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-af6cc26c-0361-4906-8088-d835d3a52faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:32.007274 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dc5d8-cdf2-48e9-ab12-4d4aeb373f9f None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:32.023013 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6cc26c-0361-4906-8088-d835d3a52faa None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:32.027521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f871c-be2d-4c68-9c2e-f46ab88765ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:32.028242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f871c-be2d-4c68-9c2e-f46ab88765ef service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:32.028606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f871c-be2d-4c68-9c2e-f46ab88765ef service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:32.028955 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f871c-be2d-4c68-9c2e-f46ab88765ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:32.037556 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-195f871c-be2d-4c68-9c2e-f46ab88765ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:32.078861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50440690-d7bc-4e9e-a479-d94a8d88e972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:32.079749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50440690-d7bc-4e9e-a479-d94a8d88e972 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:32.079983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50440690-d7bc-4e9e-a479-d94a8d88e972 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:32.080366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50440690-d7bc-4e9e-a479-d94a8d88e972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:32.094264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50440690-d7bc-4e9e-a479-d94a8d88e972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:32.096358 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50440690-d7bc-4e9e-a479-d94a8d88e972 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:32.112073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1105/2214] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:32.167486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f871c-be2d-4c68-9c2e-f46ab88765ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:32.169368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f871c-be2d-4c68-9c2e-f46ab88765ef service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:32.182609 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1110/2215] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:31 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:32.538340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50440690-d7bc-4e9e-a479-d94a8d88e972 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:32.544053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-50440690-d7bc-4e9e-a479-d94a8d88e972 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:32.580465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50440690-d7bc-4e9e-a479-d94a8d88e972 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:32.608357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:32.609904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:32.612734 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:32.612734 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] PATH_INFO: `/v3/users/d027201a8e3343238388fccb7e9d8800` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:32.614184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d027201a8e3343238388fccb7e9d8800)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:32.619624 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:32.713495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd027201a8e3343238388fccb7e9d8800'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:32.732150 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd027201a8e3343238388fccb7e9d8800'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:32.745282 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd027201a8e3343238388fccb7e9d8800'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:32.758283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd027201a8e3343238388fccb7e9d8800'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:32.759539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd027201a8e3343238388fccb7e9d8800'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:32.768486 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1106/2216] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:32 2021] DELETE /identity/v3/users/d027201a8e3343238388fccb7e9d8800 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:32.774879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69f6c-2849-4eab-8139-07ebe797f6d9 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:32.775295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69f6c-2849-4eab-8139-07ebe797f6d9 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:32.775649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a69f6c-2849-4eab-8139-07ebe797f6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:32.796725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-d7a69f6c-2849-4eab-8139-07ebe797f6d9 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:32.797993 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d7a69f6c-2849-4eab-8139-07ebe797f6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:32.878429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1111/2217] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:32.889357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:32.891291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:32.942948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69f6c-2849-4eab-8139-07ebe797f6d9 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:32.944700 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d7a69f6c-2849-4eab-8139-07ebe797f6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:32.958982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a69f6c-2849-4eab-8139-07ebe797f6d9 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:32.963505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb8a46-3db4-4031-9779-d74d91666a1a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:32.964177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0500f-89fd-4b74-987d-95d00268cfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:32.965273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0500f-89fd-4b74-987d-95d00268cfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:32.965610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0500f-89fd-4b74-987d-95d00268cfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:32.965948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0500f-89fd-4b74-987d-95d00268cfcd admin admin] PATH_INFO: `/v3/users/022dd83f39da46c9a32595f797bd02dd` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:32.967479 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0500f-89fd-4b74-987d-95d00268cfcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=022dd83f39da46c9a32595f797bd02dd)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:32.967609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c62202-ae7f-4c75-a53a-063a2b95be17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:32.968740 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c62202-ae7f-4c75-a53a-063a2b95be17 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:32.968740 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c62202-ae7f-4c75-a53a-063a2b95be17 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:32.968950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c62202-ae7f-4c75-a53a-063a2b95be17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:32.969494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0500f-89fd-4b74-987d-95d00268cfcd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:32.981531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c62202-ae7f-4c75-a53a-063a2b95be17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:32.983004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c62202-ae7f-4c75-a53a-063a2b95be17 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:32.999357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1107/2218] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:33.040423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c62202-ae7f-4c75-a53a-063a2b95be17 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:33.042610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-40c62202-ae7f-4c75-a53a-063a2b95be17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:33.046753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5ea0500f-89fd-4b74-987d-95d00268cfcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022dd83f39da46c9a32595f797bd02dd'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.063421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5ea0500f-89fd-4b74-987d-95d00268cfcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022dd83f39da46c9a32595f797bd02dd'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.064142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c62202-ae7f-4c75-a53a-063a2b95be17 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:33.064714 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5ea0500f-89fd-4b74-987d-95d00268cfcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022dd83f39da46c9a32595f797bd02dd'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.075975 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5ea0500f-89fd-4b74-987d-95d00268cfcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022dd83f39da46c9a32595f797bd02dd'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.079013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925acb2-7818-4812-82e4-3a95645fc7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:33.079937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925acb2-7818-4812-82e4-3a95645fc7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:33.080245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925acb2-7818-4812-82e4-3a95645fc7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:33.081060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925acb2-7818-4812-82e4-3a95645fc7d3 admin admin] PATH_INFO: `/v3/users/4ae9604cbb9547619b2154eccd3cfc73` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:33.083011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925acb2-7818-4812-82e4-3a95645fc7d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae9604cbb9547619b2154eccd3cfc73)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:33.085091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925acb2-7818-4812-82e4-3a95645fc7d3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:33.091306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5ea0500f-89fd-4b74-987d-95d00268cfcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022dd83f39da46c9a32595f797bd02dd'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.105001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1112/2219] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:32 2021] DELETE /identity/v3/users/022dd83f39da46c9a32595f797bd02dd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:33.110107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546753b-913f-4009-89f0-05c34c2bf55a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:33.110580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546753b-913f-4009-89f0-05c34c2bf55a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:33.110961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546753b-913f-4009-89f0-05c34c2bf55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:33.149771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c546753b-913f-4009-89f0-05c34c2bf55a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:33.151229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c546753b-913f-4009-89f0-05c34c2bf55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:33.191522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2925acb2-7818-4812-82e4-3a95645fc7d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae9604cbb9547619b2154eccd3cfc73'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.220177 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2925acb2-7818-4812-82e4-3a95645fc7d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae9604cbb9547619b2154eccd3cfc73'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.236289 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2925acb2-7818-4812-82e4-3a95645fc7d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae9604cbb9547619b2154eccd3cfc73'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.244762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1113/2220] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:33.250077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2925acb2-7818-4812-82e4-3a95645fc7d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae9604cbb9547619b2154eccd3cfc73'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.251756 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2925acb2-7818-4812-82e4-3a95645fc7d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae9604cbb9547619b2154eccd3cfc73'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.265238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546753b-913f-4009-89f0-05c34c2bf55a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:33.265485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1108/2221] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:33 2021] DELETE /identity/v3/users/4ae9604cbb9547619b2154eccd3cfc73 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:33.269098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c546753b-913f-4009-89f0-05c34c2bf55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:33.271600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d9e7c-1179-4273-87da-71483f25569f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:33.272845 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d9e7c-1179-4273-87da-71483f25569f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:33.273388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d9e7c-1179-4273-87da-71483f25569f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:33.323333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-ed7d9e7c-1179-4273-87da-71483f25569f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:33.326651 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ed7d9e7c-1179-4273-87da-71483f25569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:33.404511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546753b-913f-4009-89f0-05c34c2bf55a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:33.459525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1109/2222] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:33.471911 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d9e7c-1179-4273-87da-71483f25569f None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:33.473645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ed7d9e7c-1179-4273-87da-71483f25569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:33.496685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b78533-3fa3-4033-bbc4-5d83456e15b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:33.497788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b78533-3fa3-4033-bbc4-5d83456e15b4 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:33.498230 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b78533-3fa3-4033-bbc4-5d83456e15b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:33.498514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b78533-3fa3-4033-bbc4-5d83456e15b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:33.510845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-93b78533-3fa3-4033-bbc4-5d83456e15b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:33.542538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b78533-3fa3-4033-bbc4-5d83456e15b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:33.546703 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b78533-3fa3-4033-bbc4-5d83456e15b4 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:33.578796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1114/2223] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:33.582748 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b78533-3fa3-4033-bbc4-5d83456e15b4 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:33.584223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-93b78533-3fa3-4033-bbc4-5d83456e15b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:33.593859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d9e7c-1179-4273-87da-71483f25569f None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:33.606894 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b78533-3fa3-4033-bbc4-5d83456e15b4 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:33.609150 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5904-395e-4a61-85b0-8becadd8a702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:33.609938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5904-395e-4a61-85b0-8becadd8a702 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:33.610462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5904-395e-4a61-85b0-8becadd8a702 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:33.611628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa5904-395e-4a61-85b0-8becadd8a702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:33.619933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:33.622483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:33.623241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:33.623616 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] PATH_INFO: `/v3/projects/a341212004c7440c8acb6650a09d01f2` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:33.625467 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a341212004c7440c8acb6650a09d01f2)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:33.627690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:33.629061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa5904-395e-4a61-85b0-8becadd8a702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:33.631634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa5904-395e-4a61-85b0-8becadd8a702 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:33.648615 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1110/2224] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:33 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:33.744451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a341212004c7440c8acb6650a09d01f2', 'request_id': 'req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.754345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5904-395e-4a61-85b0-8becadd8a702 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:33.756367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f0aa5904-395e-4a61-85b0-8becadd8a702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:33.759030 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a341212004c7440c8acb6650a09d01f2', 'request_id': 'req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.773801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a341212004c7440c8acb6650a09d01f2', 'request_id': 'req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.791451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] The token cache is being invalidate because project a341212004c7440c8acb6650a09d01f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:33.791876 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.793139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:33.795469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1115/2225] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:33 2021] DELETE /identity/v3/projects/a341212004c7440c8acb6650a09d01f2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:33.803911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:33.806988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:33.929022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa5904-395e-4a61-85b0-8becadd8a702 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:33.956092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c100f-0adb-4d18-b057-e6c9e9ab0087 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:33.972658 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:33.973636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:33.973923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:33.974205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] PATH_INFO: `/v3/users/5a1d5ad621ac41cf87d4235988f6c890` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:33.977195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a1d5ad621ac41cf87d4235988f6c890)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:33.980632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:34.060004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afd8d4-7aae-4cac-be7a-b12c318703cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:34.061534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afd8d4-7aae-4cac-be7a-b12c318703cd service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:34.061807 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afd8d4-7aae-4cac-be7a-b12c318703cd service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:34.063051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afd8d4-7aae-4cac-be7a-b12c318703cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:34.070495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-54afd8d4-7aae-4cac-be7a-b12c318703cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:34.100470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a1d5ad621ac41cf87d4235988f6c890'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.135286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a1d5ad621ac41cf87d4235988f6c890'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.138108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a1d5ad621ac41cf87d4235988f6c890'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.173176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a1d5ad621ac41cf87d4235988f6c890'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.205589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a1d5ad621ac41cf87d4235988f6c890'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.246446 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1116/2226] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:33 2021] DELETE /identity/v3/users/5a1d5ad621ac41cf87d4235988f6c890 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:34.250529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:34.253872 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:34.312804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afd8d4-7aae-4cac-be7a-b12c318703cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:34.322424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afd8d4-7aae-4cac-be7a-b12c318703cd service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:34.341117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1111/2227] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:33 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:34.430549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d2fa3-c735-47d8-b46b-6178e46d4937 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:34.445795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:34.446743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:34.447034 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:34.447307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] PATH_INFO: `/v3/projects/8a8f054a9d1747cf88b9f951a0168f75` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:34.448643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a8f054a9d1747cf88b9f951a0168f75)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:34.450859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:34.528913 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a8f054a9d1747cf88b9f951a0168f75', 'request_id': 'req-e6287264-8d9d-4061-8583-afb93d79f063'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.538693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a8f054a9d1747cf88b9f951a0168f75', 'request_id': 'req-e6287264-8d9d-4061-8583-afb93d79f063'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.553020 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a8f054a9d1747cf88b9f951a0168f75', 'request_id': 'req-e6287264-8d9d-4061-8583-afb93d79f063'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.572268 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] The token cache is being invalidate because project 8a8f054a9d1747cf88b9f951a0168f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:34.572985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.573893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.575777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1117/2228] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:34 2021] DELETE /identity/v3/projects/8a8f054a9d1747cf88b9f951a0168f75 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:34.584503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c334b1c-9349-483f-84c9-ce6173766278 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:34.585069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c334b1c-9349-483f-84c9-ce6173766278 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:34.585439 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c334b1c-9349-483f-84c9-ce6173766278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:34.631993 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:34.633909 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:34.671519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-5c334b1c-9349-483f-84c9-ce6173766278 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:34.673768 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-5c334b1c-9349-483f-84c9-ce6173766278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:34.758044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1112/2229] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:34.766744 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609191e8-c54b-46f2-ade4-c9a021bd72b4 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:34.767130 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609191e8-c54b-46f2-ade4-c9a021bd72b4 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:34.767500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609191e8-c54b-46f2-ade4-c9a021bd72b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:34.788851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6287264-8d9d-4061-8583-afb93d79f063 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:34.789347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-609191e8-c54b-46f2-ade4-c9a021bd72b4 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:34.790660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-609191e8-c54b-46f2-ade4-c9a021bd72b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:34.811208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1113/2230] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:34.811356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:34.811356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:34.811356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:34.811613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] PATH_INFO: `/v3/projects/49376457b7184f718e3fb3c7c8bc560c` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:34.812936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609191e8-c54b-46f2-ade4-c9a021bd72b4 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:34.815246 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49376457b7184f718e3fb3c7c8bc560c)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:34.815452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-609191e8-c54b-46f2-ade4-c9a021bd72b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:34.818871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:34.833008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609191e8-c54b-46f2-ade4-c9a021bd72b4 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:34.839549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:34.840530 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:34.841264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:34.841264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] PATH_INFO: `/v3/projects/4ed2f02a84844a5cb62fa16c31c3bf4a` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:34.842894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed2f02a84844a5cb62fa16c31c3bf4a)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:34.844953 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:34.880871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49376457b7184f718e3fb3c7c8bc560c', 'request_id': 'req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.893995 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49376457b7184f718e3fb3c7c8bc560c', 'request_id': 'req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.901849 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49376457b7184f718e3fb3c7c8bc560c', 'request_id': 'req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.910359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed2f02a84844a5cb62fa16c31c3bf4a', 'request_id': 'req-0dc30c61-1fca-4676-9343-e0924b15d35c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.916287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] The token cache is being invalidate because project 49376457b7184f718e3fb3c7c8bc560c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:34.916858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.919088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.920908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed2f02a84844a5cb62fa16c31c3bf4a', 'request_id': 'req-0dc30c61-1fca-4676-9343-e0924b15d35c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.925745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1118/2231] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:34 2021] DELETE /identity/v3/projects/49376457b7184f718e3fb3c7c8bc560c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:34.926802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:34.928608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:34.929507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed2f02a84844a5cb62fa16c31c3bf4a', 'request_id': 'req-0dc30c61-1fca-4676-9343-e0924b15d35c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.941528 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] The token cache is being invalidate because project 4ed2f02a84844a5cb62fa16c31c3bf4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:34.941926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.942758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:34.945090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1114/2232] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:34 2021] DELETE /identity/v3/projects/4ed2f02a84844a5cb62fa16c31c3bf4a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:34.945685 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:34.947036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:35.017323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc30c61-1fca-4676-9343-e0924b15d35c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:35.022716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:35.023681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.024254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.024488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] PATH_INFO: `/v3/users/9e08f20883084f4694f1df4ff08877ca` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.025798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e08f20883084f4694f1df4ff08877ca)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:35.027773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:35.045078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7836f44-1cef-4f41-bedb-2ce8ff659ed5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:35.051456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f348f9-dd24-48c5-8d4b-e5eae3bc5992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:35.052374 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f348f9-dd24-48c5-8d4b-e5eae3bc5992 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.052751 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f348f9-dd24-48c5-8d4b-e5eae3bc5992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.053902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f348f9-dd24-48c5-8d4b-e5eae3bc5992 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.053902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f348f9-dd24-48c5-8d4b-e5eae3bc5992 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:35.054144 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f348f9-dd24-48c5-8d4b-e5eae3bc5992 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:35.055877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f348f9-dd24-48c5-8d4b-e5eae3bc5992 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:35.071150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1119/2233] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:35.071923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f348f9-dd24-48c5-8d4b-e5eae3bc5992 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:35.074080 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a5f348f9-dd24-48c5-8d4b-e5eae3bc5992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:35.089888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f348f9-dd24-48c5-8d4b-e5eae3bc5992 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:35.095158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:35.096420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.096921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.097319 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] PATH_INFO: `/v3/users/ea8cb0884c01487ab7496b670bc4c43b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.098425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8cb0884c01487ab7496b670bc4c43b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:35.100437 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:35.105400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e08f20883084f4694f1df4ff08877ca'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.133045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e08f20883084f4694f1df4ff08877ca'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.145462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e08f20883084f4694f1df4ff08877ca'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.154925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e08f20883084f4694f1df4ff08877ca'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.155939 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e08f20883084f4694f1df4ff08877ca'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.164957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8cb0884c01487ab7496b670bc4c43b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.165786 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1115/2234] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:34 2021] DELETE /identity/v3/users/9e08f20883084f4694f1df4ff08877ca => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:35.166612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:35.169073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:35.188290 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8cb0884c01487ab7496b670bc4c43b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.189279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8cb0884c01487ab7496b670bc4c43b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.206303 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8cb0884c01487ab7496b670bc4c43b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.212922 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8cb0884c01487ab7496b670bc4c43b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.222868 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1120/2235] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:35 2021] DELETE /identity/v3/users/ea8cb0884c01487ab7496b670bc4c43b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:35.276044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fb806-dbde-48a4-8f52-095cafd7a380 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:35.383981 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e9da6-487d-476c-8c84-5b66ccc8b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:35.385057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e9da6-487d-476c-8c84-5b66ccc8b19a admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.385404 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e9da6-487d-476c-8c84-5b66ccc8b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.385760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e9da6-487d-476c-8c84-5b66ccc8b19a admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.386538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e9da6-487d-476c-8c84-5b66ccc8b19a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:35.388693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97e9da6-487d-476c-8c84-5b66ccc8b19a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:35.421694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1116/2236] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:35 2021] POST /identity/v3/projects => generated 375 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:35.426524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:35.428130 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:35.449637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e89de-9113-4fdf-aa6e-db686e611061 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:35.523896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb96f5e-890f-4d80-8805-40812ed1255e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:35.524764 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96f5e-890f-4d80-8805-40812ed1255e admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.524893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96f5e-890f-4d80-8805-40812ed1255e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.526098 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96f5e-890f-4d80-8805-40812ed1255e admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.526829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb96f5e-890f-4d80-8805-40812ed1255e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:35.529762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb96f5e-890f-4d80-8805-40812ed1255e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:35.561314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1121/2237] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:35 2021] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:35.563933 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e9da6-487d-476c-8c84-5b66ccc8b19a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:35.582464 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e9da6-487d-476c-8c84-5b66ccc8b19a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:35.588467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44317784-286c-47fd-ad03-37e79b953ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:35.589438 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44317784-286c-47fd-ad03-37e79b953ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.589846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44317784-286c-47fd-ad03-37e79b953ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.590184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44317784-286c-47fd-ad03-37e79b953ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.591097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44317784-286c-47fd-ad03-37e79b953ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:35.593041 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44317784-286c-47fd-ad03-37e79b953ed1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:35.608196 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1117/2238] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:35 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:35.609897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb96f5e-890f-4d80-8805-40812ed1255e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:35.620527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb96f5e-890f-4d80-8805-40812ed1255e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:35.626408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6820698-010f-46b3-b0ba-d216bfbdc14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:35.627662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6820698-010f-46b3-b0ba-d216bfbdc14e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.628000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6820698-010f-46b3-b0ba-d216bfbdc14e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.628507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6820698-010f-46b3-b0ba-d216bfbdc14e admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.629396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6820698-010f-46b3-b0ba-d216bfbdc14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:35.632727 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6820698-010f-46b3-b0ba-d216bfbdc14e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:35.634307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44317784-286c-47fd-ad03-37e79b953ed1 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:35.636236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-44317784-286c-47fd-ad03-37e79b953ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:35.652805 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44317784-286c-47fd-ad03-37e79b953ed1 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:35.662141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:35.663339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.663786 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.664231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] PATH_INFO: `/v3/projects/80900a5c58764e2ea477b3986b59c625` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.665298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1122/2239] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:35 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:35.668963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80900a5c58764e2ea477b3986b59c625)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:35.670365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6820698-010f-46b3-b0ba-d216bfbdc14e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:35.670810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:35.688955 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6820698-010f-46b3-b0ba-d216bfbdc14e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:35.694810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94255712-8a0e-4c68-baab-f4068d2614ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:35.695914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94255712-8a0e-4c68-baab-f4068d2614ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.696029 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94255712-8a0e-4c68-baab-f4068d2614ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.696226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94255712-8a0e-4c68-baab-f4068d2614ad admin admin] PATH_INFO: `/v3/projects/9998924999b94986a7f786981256c256/users/c90bb041048043aea8984fb2aa5876d9/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.718199 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94255712-8a0e-4c68-baab-f4068d2614ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9998924999b94986a7f786981256c256, user_id=c90bb041048043aea8984fb2aa5876d9, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:35.721026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94255712-8a0e-4c68-baab-f4068d2614ad admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:35.729841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80900a5c58764e2ea477b3986b59c625', 'request_id': 'req-187150ce-f7bb-485c-abf1-dd04f17eee94'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.738643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80900a5c58764e2ea477b3986b59c625', 'request_id': 'req-187150ce-f7bb-485c-abf1-dd04f17eee94'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.745089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1123/2240] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:35 2021] PUT /identity/v3/projects/9998924999b94986a7f786981256c256/users/c90bb041048043aea8984fb2aa5876d9/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:35.755169 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a691f7-067b-4a38-bd62-3b25fdff8e17 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.755371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a691f7-067b-4a38-bd62-3b25fdff8e17 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.755692 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a691f7-067b-4a38-bd62-3b25fdff8e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.758744 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80900a5c58764e2ea477b3986b59c625', 'request_id': 'req-187150ce-f7bb-485c-abf1-dd04f17eee94'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.771652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] The token cache is being invalidate because project 80900a5c58764e2ea477b3986b59c625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:35.772014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.773362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:35.775897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1118/2241] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:35 2021] DELETE /identity/v3/projects/80900a5c58764e2ea477b3986b59c625 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:35.785000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:35.787362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:35.790230 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-52a691f7-067b-4a38-bd62-3b25fdff8e17 None None] MFA Rules not processed for user `c90bb041048043aea8984fb2aa5876d9`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:35.792167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-52a691f7-067b-4a38-bd62-3b25fdff8e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:35.876735 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1124/2242] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:35 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:35.878722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f95e-d199-4a63-a0dd-b47d2a27ba6a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.879171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f95e-d199-4a63-a0dd-b47d2a27ba6a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.879549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f95e-d199-4a63-a0dd-b47d2a27ba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.897814 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187150ce-f7bb-485c-abf1-dd04f17eee94 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:35.899580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-3a49f95e-d199-4a63-a0dd-b47d2a27ba6a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:35.900880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3a49f95e-d199-4a63-a0dd-b47d2a27ba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:35.969288 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:35.970502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:35.971087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:35.971632 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] PATH_INFO: `/v3/projects/6598b4cbd80d480ca76cf12e3a34bdf5` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:35.973840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6598b4cbd80d480ca76cf12e3a34bdf5)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:35.975907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:35.989489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1125/2243] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:35.990959 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49f95e-d199-4a63-a0dd-b47d2a27ba6a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:35.992507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3a49f95e-d199-4a63-a0dd-b47d2a27ba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:36.041123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6598b4cbd80d480ca76cf12e3a34bdf5', 'request_id': 'req-d3bc3649-43c6-427b-8afa-3d02f8325efa'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:36.056509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6598b4cbd80d480ca76cf12e3a34bdf5', 'request_id': 'req-d3bc3649-43c6-427b-8afa-3d02f8325efa'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:36.066747 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6598b4cbd80d480ca76cf12e3a34bdf5', 'request_id': 'req-d3bc3649-43c6-427b-8afa-3d02f8325efa'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:36.079926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] The token cache is being invalidate because project 6598b4cbd80d480ca76cf12e3a34bdf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:36.080601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:36.081742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d3bc3649-43c6-427b-8afa-3d02f8325efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:36.083577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49f95e-d199-4a63-a0dd-b47d2a27ba6a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:36.091249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1119/2244] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:35 2021] DELETE /identity/v3/projects/6598b4cbd80d480ca76cf12e3a34bdf5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:36.093301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aaf52-89ed-4e86-9e67-8ec1a8b8958d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.093651 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aaf52-89ed-4e86-9e67-8ec1a8b8958d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.094022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07aaf52-89ed-4e86-9e67-8ec1a8b8958d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.120263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f07aaf52-89ed-4e86-9e67-8ec1a8b8958d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:36.123077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f07aaf52-89ed-4e86-9e67-8ec1a8b8958d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:36.156339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404a771-b8fc-4672-8a5a-b99c7c054c6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:36.157918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404a771-b8fc-4672-8a5a-b99c7c054c6f service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.158454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404a771-b8fc-4672-8a5a-b99c7c054c6f service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.158971 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404a771-b8fc-4672-8a5a-b99c7c054c6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.162142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-2404a771-b8fc-4672-8a5a-b99c7c054c6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:36.196681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1120/2245] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:36.198158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37714e-6652-45b5-aecc-7bc39065ff6f None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.198653 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37714e-6652-45b5-aecc-7bc39065ff6f None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.199002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37714e-6652-45b5-aecc-7bc39065ff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.230881 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-0c37714e-6652-45b5-aecc-7bc39065ff6f None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:36.232269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0c37714e-6652-45b5-aecc-7bc39065ff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:36.243922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1121/2246] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:36.252961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37714e-6652-45b5-aecc-7bc39065ff6f None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:36.253149 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404a771-b8fc-4672-8a5a-b99c7c054c6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:36.254745 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404a771-b8fc-4672-8a5a-b99c7c054c6f service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:36.264552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37714e-6652-45b5-aecc-7bc39065ff6f None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:36.265487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1126/2247] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:35 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:36.268307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f703c5-e7a3-45b8-9c9c-bc6eec5ca9bf None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.268803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f703c5-e7a3-45b8-9c9c-bc6eec5ca9bf None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.269367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f703c5-e7a3-45b8-9c9c-bc6eec5ca9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.269927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577f505-e830-4e27-b305-20d63eadbcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:36.270913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577f505-e830-4e27-b305-20d63eadbcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.270913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577f505-e830-4e27-b305-20d63eadbcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.271195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577f505-e830-4e27-b305-20d63eadbcc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.272337 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577f505-e830-4e27-b305-20d63eadbcc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:36.272809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577f505-e830-4e27-b305-20d63eadbcc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:36.274570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f577f505-e830-4e27-b305-20d63eadbcc4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:36.292326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1122/2248] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:36.294277 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577f505-e830-4e27-b305-20d63eadbcc4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:36.298159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-40f703c5-e7a3-45b8-9c9c-bc6eec5ca9bf None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:36.300099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-40f703c5-e7a3-45b8-9c9c-bc6eec5ca9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:36.305497 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577f505-e830-4e27-b305-20d63eadbcc4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:36.312961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1127/2249] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:36.319845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f703c5-e7a3-45b8-9c9c-bc6eec5ca9bf None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:36.324259 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b99d5-89b8-4a8f-9e1d-3365cf3ee9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:36.325210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b99d5-89b8-4a8f-9e1d-3365cf3ee9ef admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.325812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b99d5-89b8-4a8f-9e1d-3365cf3ee9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.328323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b99d5-89b8-4a8f-9e1d-3365cf3ee9ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.331066 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b99d5-89b8-4a8f-9e1d-3365cf3ee9ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:36.335814 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b99d5-89b8-4a8f-9e1d-3365cf3ee9ef admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:36.351666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f703c5-e7a3-45b8-9c9c-bc6eec5ca9bf None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:36.360524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382dbce-5042-423f-b2ac-396131e0cd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:36.362657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382dbce-5042-423f-b2ac-396131e0cd91 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.363052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382dbce-5042-423f-b2ac-396131e0cd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.363402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382dbce-5042-423f-b2ac-396131e0cd91 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.364444 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382dbce-5042-423f-b2ac-396131e0cd91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:36.365202 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382dbce-5042-423f-b2ac-396131e0cd91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:36.367095 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382dbce-5042-423f-b2ac-396131e0cd91 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:36.387479 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1128/2250] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:36.389004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382dbce-5042-423f-b2ac-396131e0cd91 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:36.403923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382dbce-5042-423f-b2ac-396131e0cd91 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:36.407789 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1123/2251] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:36 2021] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:36.410099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b99d5-89b8-4a8f-9e1d-3365cf3ee9ef admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:36.490254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426610-6db3-480d-8ede-e734a86cc5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:36.490937 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426610-6db3-480d-8ede-e734a86cc5fc admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.491224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426610-6db3-480d-8ede-e734a86cc5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.491666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7426610-6db3-480d-8ede-e734a86cc5fc admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.492406 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7426610-6db3-480d-8ede-e734a86cc5fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:36.495149 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7426610-6db3-480d-8ede-e734a86cc5fc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:36.557110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b99d5-89b8-4a8f-9e1d-3365cf3ee9ef admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:36.564447 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de334d4d-ba90-43cc-b256-0a5847246172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:36.565856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de334d4d-ba90-43cc-b256-0a5847246172 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.566292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de334d4d-ba90-43cc-b256-0a5847246172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.566722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de334d4d-ba90-43cc-b256-0a5847246172 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.567629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de334d4d-ba90-43cc-b256-0a5847246172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:36.570091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de334d4d-ba90-43cc-b256-0a5847246172 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:36.573180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1129/2252] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:36 2021] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:36.574880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426610-6db3-480d-8ede-e734a86cc5fc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:36.601746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1124/2253] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:36 2021] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:36.607745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de334d4d-ba90-43cc-b256-0a5847246172 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:36.622841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de334d4d-ba90-43cc-b256-0a5847246172 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:36.732365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563d221-41c0-4655-86b6-f93e52d48cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:36.735081 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563d221-41c0-4655-86b6-f93e52d48cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.735751 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563d221-41c0-4655-86b6-f93e52d48cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.736539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563d221-41c0-4655-86b6-f93e52d48cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.740281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563d221-41c0-4655-86b6-f93e52d48cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:36.743723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5563d221-41c0-4655-86b6-f93e52d48cb4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:36.778393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1125/2254] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:36 2021] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:36.783795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563d221-41c0-4655-86b6-f93e52d48cb4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:36.810155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563d221-41c0-4655-86b6-f93e52d48cb4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:36.818111 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7426610-6db3-480d-8ede-e734a86cc5fc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:36.819728 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a4680-f90c-46a0-b452-c56a71e1dffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:36.820684 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4680-f90c-46a0-b452-c56a71e1dffb admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.821327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4680-f90c-46a0-b452-c56a71e1dffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.821816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a4680-f90c-46a0-b452-c56a71e1dffb admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.824132 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a4680-f90c-46a0-b452-c56a71e1dffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:36.826899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a4680-f90c-46a0-b452-c56a71e1dffb admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:36.834811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bf35c-acba-49f4-975f-d300e4cbc85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:36.840144 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bf35c-acba-49f4-975f-d300e4cbc85f admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.840812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bf35c-acba-49f4-975f-d300e4cbc85f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.841458 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030bf35c-acba-49f4-975f-d300e4cbc85f admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.842621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bf35c-acba-49f4-975f-d300e4cbc85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:36.850662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030bf35c-acba-49f4-975f-d300e4cbc85f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:36.872685 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1126/2255] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:36 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:36.881483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a4680-f90c-46a0-b452-c56a71e1dffb admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:36.907789 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a4680-f90c-46a0-b452-c56a71e1dffb admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:36.915666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1130/2256] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:36 2021] POST /identity/v3/users => generated 295 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:36.916404 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1b3b8-cdb2-4759-8037-c19b23616138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:36.917724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1b3b8-cdb2-4759-8037-c19b23616138 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.918270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1b3b8-cdb2-4759-8037-c19b23616138 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.918676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1b3b8-cdb2-4759-8037-c19b23616138 admin admin] PATH_INFO: `/v3/projects/45dbe80e41a348f7bb897a6e099ef4ee/users/359cfa254c2b4e3a87fe7538c9e29d09/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.925018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bf35c-acba-49f4-975f-d300e4cbc85f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:36.946835 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030bf35c-acba-49f4-975f-d300e4cbc85f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:36.949500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1b3b8-cdb2-4759-8037-c19b23616138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45dbe80e41a348f7bb897a6e099ef4ee, user_id=359cfa254c2b4e3a87fe7538c9e29d09, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:36.951904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbcd77-08ea-42f1-a5ec-e41818b1b7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:36.952810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbcd77-08ea-42f1-a5ec-e41818b1b7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:36.953093 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbcd77-08ea-42f1-a5ec-e41818b1b7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:36.953405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfbcd77-08ea-42f1-a5ec-e41818b1b7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:36.954300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbcd77-08ea-42f1-a5ec-e41818b1b7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:36.956956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfbcd77-08ea-42f1-a5ec-e41818b1b7d2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:36.958438 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1b3b8-cdb2-4759-8037-c19b23616138 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:36.991236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1131/2257] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:36 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:36.994659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbcd77-08ea-42f1-a5ec-e41818b1b7d2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:37.008555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1127/2258] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:36 2021] PUT /identity/v3/projects/45dbe80e41a348f7bb897a6e099ef4ee/users/359cfa254c2b4e3a87fe7538c9e29d09/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:37.022098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8504-67e0-43df-9cf0-85f190c8b0a3 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:37.022293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8504-67e0-43df-9cf0-85f190c8b0a3 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:37.022556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd8504-67e0-43df-9cf0-85f190c8b0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:37.030930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfbcd77-08ea-42f1-a5ec-e41818b1b7d2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:37.119569 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad317b-aed8-4276-a3fe-79c28a7a439c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:37.120301 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad317b-aed8-4276-a3fe-79c28a7a439c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:37.120600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad317b-aed8-4276-a3fe-79c28a7a439c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:37.121297 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad317b-aed8-4276-a3fe-79c28a7a439c admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:37.122043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad317b-aed8-4276-a3fe-79c28a7a439c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:37.122657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-a5cd8504-67e0-43df-9cf0-85f190c8b0a3 None None] MFA Rules not processed for user `359cfa254c2b4e3a87fe7538c9e29d09`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:37.123807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad317b-aed8-4276-a3fe-79c28a7a439c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:37.127562 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a5cd8504-67e0-43df-9cf0-85f190c8b0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:37.140854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1132/2259] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:36 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:37.141893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad317b-aed8-4276-a3fe-79c28a7a439c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:37.168475 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad317b-aed8-4276-a3fe-79c28a7a439c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:37.177390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386a577-a6bc-445f-b6f4-ef3910e07a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:37.179068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386a577-a6bc-445f-b6f4-ef3910e07a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:37.179657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386a577-a6bc-445f-b6f4-ef3910e07a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:37.180163 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386a577-a6bc-445f-b6f4-ef3910e07a97 admin admin] PATH_INFO: `/v3/projects/1ce56505d55548d89ab635e05756a184/users/ea2be2585c084e26a3e0fb3a79bd4c95/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:37.264376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386a577-a6bc-445f-b6f4-ef3910e07a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce56505d55548d89ab635e05756a184, user_id=ea2be2585c084e26a3e0fb3a79bd4c95, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:37.273920 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386a577-a6bc-445f-b6f4-ef3910e07a97 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:37.304778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1128/2260] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:37 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:37.342746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd8504-67e0-43df-9cf0-85f190c8b0a3 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:37.342746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a5cd8504-67e0-43df-9cf0-85f190c8b0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:37.366587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1133/2261] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:37 2021] PUT /identity/v3/projects/1ce56505d55548d89ab635e05756a184/users/ea2be2585c084e26a3e0fb3a79bd4c95/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:37.379229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e673d-0e86-472e-8f05-4e2591ed846c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:37.379588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e673d-0e86-472e-8f05-4e2591ed846c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:37.379791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e673d-0e86-472e-8f05-4e2591ed846c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:37.415324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b88e673d-0e86-472e-8f05-4e2591ed846c None None] MFA Rules not processed for user `ea2be2585c084e26a3e0fb3a79bd4c95`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:37.416219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b88e673d-0e86-472e-8f05-4e2591ed846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:37.434941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd8504-67e0-43df-9cf0-85f190c8b0a3 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:37.523248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e96a60-1ce2-4cb9-94f7-7adf44340449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:37.524110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96a60-1ce2-4cb9-94f7-7adf44340449 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:37.524394 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96a60-1ce2-4cb9-94f7-7adf44340449 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:37.524694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96a60-1ce2-4cb9-94f7-7adf44340449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:37.527307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1134/2262] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:37 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:37.537971 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e673d-0e86-472e-8f05-4e2591ed846c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:37.542699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b88e673d-0e86-472e-8f05-4e2591ed846c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:37.563445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e673d-0e86-472e-8f05-4e2591ed846c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:37.568029 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cc58c-99f1-42bd-b69e-22fa4e45f204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:37.568754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cc58c-99f1-42bd-b69e-22fa4e45f204 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:37.569035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cc58c-99f1-42bd-b69e-22fa4e45f204 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:37.569308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cc58c-99f1-42bd-b69e-22fa4e45f204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:37.580625 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cc58c-99f1-42bd-b69e-22fa4e45f204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:37.583753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cc58c-99f1-42bd-b69e-22fa4e45f204 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:37.597093 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1135/2263] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:37 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:49:37.632170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e96a60-1ce2-4cb9-94f7-7adf44340449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:37.636065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e96a60-1ce2-4cb9-94f7-7adf44340449 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:37.648192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1129/2264] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:37 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:38.878855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6e6d-3f95-41bb-9cc9-511d7e771e61 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:38.879782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6e6d-3f95-41bb-9cc9-511d7e771e61 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:38.880239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6e6d-3f95-41bb-9cc9-511d7e771e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:38.922884 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-ac4b6e6d-3f95-41bb-9cc9-511d7e771e61 None None] MFA Rules not processed for user `17b84b9ba4894db6985fcf9da882f56c`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:38.924421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ac4b6e6d-3f95-41bb-9cc9-511d7e771e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:39.035671 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1136/2265] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:38 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:39.048607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960f062-ea69-4a66-ae9d-36306d245598 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:39.049313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960f062-ea69-4a66-ae9d-36306d245598 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:39.049687 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960f062-ea69-4a66-ae9d-36306d245598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:39.087938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-9960f062-ea69-4a66-ae9d-36306d245598 None None] MFA Rules not processed for user `17b84b9ba4894db6985fcf9da882f56c`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:39.089455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9960f062-ea69-4a66-ae9d-36306d245598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:39.120974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1130/2266] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:39 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:39.139774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6e6d-3f95-41bb-9cc9-511d7e771e61 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:39.141391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ac4b6e6d-3f95-41bb-9cc9-511d7e771e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:39.313725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6e6d-3f95-41bb-9cc9-511d7e771e61 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:39.339337 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5809-69b4-40d1-a874-90ce58e3fadb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:39.340381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5809-69b4-40d1-a874-90ce58e3fadb service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:39.340897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5809-69b4-40d1-a874-90ce58e3fadb service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:39.341347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5809-69b4-40d1-a874-90ce58e3fadb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:39.354555 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e5809-69b4-40d1-a874-90ce58e3fadb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:39.356299 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e5809-69b4-40d1-a874-90ce58e3fadb service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:39.371053 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1137/2267] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:39 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:40.325301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4383b6-efb0-4c9e-85da-216206316694 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:40.329063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4383b6-efb0-4c9e-85da-216206316694 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:40.329756 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4383b6-efb0-4c9e-85da-216206316694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:40.372037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-3c4383b6-efb0-4c9e-85da-216206316694 None None] MFA Rules not processed for user `17b84b9ba4894db6985fcf9da882f56c`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:40.373435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-3c4383b6-efb0-4c9e-85da-216206316694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:40.387586 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1131/2268] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:40 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:43.267123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5809-69b4-40d1-a874-90ce58e3fadb service nova] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:43.367954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5809-69b4-40d1-a874-90ce58e3fadb service nova] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:43.374841 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:43.375812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:43.376159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:43.376440 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] PATH_INFO: `/v3/users/359cfa254c2b4e3a87fe7538c9e29d09` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:43.377804 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=359cfa254c2b4e3a87fe7538c9e29d09)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:43.379749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:43.441572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359cfa254c2b4e3a87fe7538c9e29d09'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:43.463408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359cfa254c2b4e3a87fe7538c9e29d09'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:43.464607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359cfa254c2b4e3a87fe7538c9e29d09'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:43.472596 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359cfa254c2b4e3a87fe7538c9e29d09'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:43.482340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359cfa254c2b4e3a87fe7538c9e29d09'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:43.489276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1138/2269] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:43 2021] DELETE /identity/v3/users/359cfa254c2b4e3a87fe7538c9e29d09 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:43.493560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f73c3-102f-4795-aac4-a82ebca25b9a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:43.494118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f73c3-102f-4795-aac4-a82ebca25b9a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:43.494214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f73c3-102f-4795-aac4-a82ebca25b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:43.513052 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-109f73c3-102f-4795-aac4-a82ebca25b9a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:43.514262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-109f73c3-102f-4795-aac4-a82ebca25b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:43.577732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1132/2270] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:43.588380 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:43.590016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:43.653024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ce4c2-2381-4a44-9896-7d60173b2d8d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:43.656891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915dedf-dba9-492c-b4ac-908f3b81bdc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:43.657469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915dedf-dba9-492c-b4ac-908f3b81bdc3 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:43.657749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915dedf-dba9-492c-b4ac-908f3b81bdc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:43.658165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915dedf-dba9-492c-b4ac-908f3b81bdc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:43.678238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915dedf-dba9-492c-b4ac-908f3b81bdc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:43.679721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915dedf-dba9-492c-b4ac-908f3b81bdc3 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:43.691982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1139/2271] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:43.993530 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f73c3-102f-4795-aac4-a82ebca25b9a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:43.995408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-109f73c3-102f-4795-aac4-a82ebca25b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:44.016669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f73c3-102f-4795-aac4-a82ebca25b9a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:44.030414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:44.030414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.030414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.030414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] PATH_INFO: `/v3/projects/45dbe80e41a348f7bb897a6e099ef4ee` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.031068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45dbe80e41a348f7bb897a6e099ef4ee)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:44.031068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:44.078484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45dbe80e41a348f7bb897a6e099ef4ee', 'request_id': 'req-d504c574-ae05-428b-8f20-2a2fc26025c1'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:44.089286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45dbe80e41a348f7bb897a6e099ef4ee', 'request_id': 'req-d504c574-ae05-428b-8f20-2a2fc26025c1'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:44.095922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45dbe80e41a348f7bb897a6e099ef4ee', 'request_id': 'req-d504c574-ae05-428b-8f20-2a2fc26025c1'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:44.113224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] The token cache is being invalidate because project 45dbe80e41a348f7bb897a6e099ef4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:44.113224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:44.113224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d504c574-ae05-428b-8f20-2a2fc26025c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:44.113224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1133/2272] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:43 2021] DELETE /identity/v3/projects/45dbe80e41a348f7bb897a6e099ef4ee => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:44.115623 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07857744-3f77-48a4-84ea-c9c376703f0a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.115910 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07857744-3f77-48a4-84ea-c9c376703f0a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.116185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07857744-3f77-48a4-84ea-c9c376703f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.135953 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-07857744-3f77-48a4-84ea-c9c376703f0a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:44.137190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-07857744-3f77-48a4-84ea-c9c376703f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:44.207260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1140/2273] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:44.211810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429c94d-e572-4676-b5e2-8c803e3f01dd None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.212101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429c94d-e572-4676-b5e2-8c803e3f01dd None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.212377 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429c94d-e572-4676-b5e2-8c803e3f01dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.232164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7429c94d-e572-4676-b5e2-8c803e3f01dd None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:44.233435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7429c94d-e572-4676-b5e2-8c803e3f01dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:44.242126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1134/2274] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:44.246878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07857744-3f77-48a4-84ea-c9c376703f0a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:44.257321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07857744-3f77-48a4-84ea-c9c376703f0a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:44.262749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec0d1b-55ea-4f32-b46d-948539dd1323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:44.263430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec0d1b-55ea-4f32-b46d-948539dd1323 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.263734 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec0d1b-55ea-4f32-b46d-948539dd1323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.263970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec0d1b-55ea-4f32-b46d-948539dd1323 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.265802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec0d1b-55ea-4f32-b46d-948539dd1323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:44.265802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec0d1b-55ea-4f32-b46d-948539dd1323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:44.266857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec0d1b-55ea-4f32-b46d-948539dd1323 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:44.283489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1141/2275] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:44.284792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429c94d-e572-4676-b5e2-8c803e3f01dd None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:44.294234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429c94d-e572-4676-b5e2-8c803e3f01dd None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:44.300209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd89097-10bf-4dea-a4c4-8a56ee178cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:44.300933 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd89097-10bf-4dea-a4c4-8a56ee178cba admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.301224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd89097-10bf-4dea-a4c4-8a56ee178cba admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.301530 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd89097-10bf-4dea-a4c4-8a56ee178cba admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.302263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd89097-10bf-4dea-a4c4-8a56ee178cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:44.304175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd89097-10bf-4dea-a4c4-8a56ee178cba admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:44.338000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1135/2276] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:44 2021] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:44.342161 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec0d1b-55ea-4f32-b46d-948539dd1323 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:44.355753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec0d1b-55ea-4f32-b46d-948539dd1323 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:44.426605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144d229-45de-4afd-8763-64e003fe23ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:44.427287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144d229-45de-4afd-8763-64e003fe23ad admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.427564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144d229-45de-4afd-8763-64e003fe23ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.427833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144d229-45de-4afd-8763-64e003fe23ad admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.428853 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144d229-45de-4afd-8763-64e003fe23ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:44.432306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144d229-45de-4afd-8763-64e003fe23ad admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:44.455082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1142/2277] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:44 2021] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:44.459256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd89097-10bf-4dea-a4c4-8a56ee178cba admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:44.470918 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd89097-10bf-4dea-a4c4-8a56ee178cba admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:44.475339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f11d8-97b9-4e6a-882a-3deec1445592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:44.476121 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f11d8-97b9-4e6a-882a-3deec1445592 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.476491 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f11d8-97b9-4e6a-882a-3deec1445592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.476924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f11d8-97b9-4e6a-882a-3deec1445592 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.484668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f11d8-97b9-4e6a-882a-3deec1445592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:44.484668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f11d8-97b9-4e6a-882a-3deec1445592 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:44.491146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1136/2278] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:44 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:49:44.495226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144d229-45de-4afd-8763-64e003fe23ad admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:44.506108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144d229-45de-4afd-8763-64e003fe23ad admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:44.510723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f00bd-8c40-4f56-b7f6-4f82445cf683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:44.511383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f00bd-8c40-4f56-b7f6-4f82445cf683 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.511666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f00bd-8c40-4f56-b7f6-4f82445cf683 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.511992 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f00bd-8c40-4f56-b7f6-4f82445cf683 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.512778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f00bd-8c40-4f56-b7f6-4f82445cf683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:44.514369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f00bd-8c40-4f56-b7f6-4f82445cf683 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:44.524828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1143/2279] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:44 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:44.529060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f11d8-97b9-4e6a-882a-3deec1445592 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:44.539492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f11d8-97b9-4e6a-882a-3deec1445592 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:44.544966 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658d18b-1232-43dd-ab68-9de471786ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:44.545855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658d18b-1232-43dd-ab68-9de471786ded admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.546134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658d18b-1232-43dd-ab68-9de471786ded admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.546515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658d18b-1232-43dd-ab68-9de471786ded admin admin] PATH_INFO: `/v3/projects/8b0d64db394f4065a6451fc372b6bf56/users/5f80ec28714b4664bcdbf53673e85802/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.563195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658d18b-1232-43dd-ab68-9de471786ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0d64db394f4065a6451fc372b6bf56, user_id=5f80ec28714b4664bcdbf53673e85802, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:44.566216 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658d18b-1232-43dd-ab68-9de471786ded admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:44.581286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1137/2280] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:44 2021] PUT /identity/v3/projects/8b0d64db394f4065a6451fc372b6bf56/users/5f80ec28714b4664bcdbf53673e85802/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:44.592490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef75c6e-382d-46ad-9a48-634def2c4ec5 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.592871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef75c6e-382d-46ad-9a48-634def2c4ec5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.593177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef75c6e-382d-46ad-9a48-634def2c4ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.620819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-7ef75c6e-382d-46ad-9a48-634def2c4ec5 None None] MFA Rules not processed for user `5f80ec28714b4664bcdbf53673e85802`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:44.622459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-7ef75c6e-382d-46ad-9a48-634def2c4ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:44.693265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1144/2281] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:44 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:44.698075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658d18b-1232-43dd-ab68-9de471786ded admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:44.766101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658d18b-1232-43dd-ab68-9de471786ded admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:44.771961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d97ba-6fe2-4b54-b0ce-b942217cbf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:44.772778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d97ba-6fe2-4b54-b0ce-b942217cbf91 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.773160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d97ba-6fe2-4b54-b0ce-b942217cbf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.773529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040d97ba-6fe2-4b54-b0ce-b942217cbf91 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.774319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d97ba-6fe2-4b54-b0ce-b942217cbf91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:44.776620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040d97ba-6fe2-4b54-b0ce-b942217cbf91 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:44.809387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1138/2282] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:44 2021] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:44.813383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef75c6e-382d-46ad-9a48-634def2c4ec5 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:44.824917 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef75c6e-382d-46ad-9a48-634def2c4ec5 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:44.889570 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c8e6b-b96c-40c0-a1aa-d1f9102184fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:44.890247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8e6b-b96c-40c0-a1aa-d1f9102184fe admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.890524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8e6b-b96c-40c0-a1aa-d1f9102184fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.890794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c8e6b-b96c-40c0-a1aa-d1f9102184fe admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.891513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c8e6b-b96c-40c0-a1aa-d1f9102184fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:44.894024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c8e6b-b96c-40c0-a1aa-d1f9102184fe admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:44.926510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1145/2283] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:44 2021] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:44.928287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d97ba-6fe2-4b54-b0ce-b942217cbf91 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:44.941030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040d97ba-6fe2-4b54-b0ce-b942217cbf91 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:44.947198 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f413f-45e1-4467-8105-4d91e7ebc3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:44.948025 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f413f-45e1-4467-8105-4d91e7ebc3de admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.948772 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f413f-45e1-4467-8105-4d91e7ebc3de admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.949191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f413f-45e1-4467-8105-4d91e7ebc3de admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.949982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f413f-45e1-4467-8105-4d91e7ebc3de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:44.951602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f413f-45e1-4467-8105-4d91e7ebc3de admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:44.967971 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1139/2284] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:44 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:44.971404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c8e6b-b96c-40c0-a1aa-d1f9102184fe admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:44.984354 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c8e6b-b96c-40c0-a1aa-d1f9102184fe admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:44.989599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32eb33-b8ee-4ca6-963d-433ad9f6926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:44.990260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32eb33-b8ee-4ca6-963d-433ad9f6926a admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:44.990569 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32eb33-b8ee-4ca6-963d-433ad9f6926a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:44.990838 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32eb33-b8ee-4ca6-963d-433ad9f6926a admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:44.991578 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32eb33-b8ee-4ca6-963d-433ad9f6926a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:44.993220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32eb33-b8ee-4ca6-963d-433ad9f6926a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:45.007666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1146/2285] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:44 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:45.008857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f413f-45e1-4467-8105-4d91e7ebc3de admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:45.019520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f413f-45e1-4467-8105-4d91e7ebc3de admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:45.024607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82130a-27ff-4273-873f-23d4299e5c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:45.025427 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82130a-27ff-4273-873f-23d4299e5c95 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:45.025703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82130a-27ff-4273-873f-23d4299e5c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:45.025975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82130a-27ff-4273-873f-23d4299e5c95 admin admin] PATH_INFO: `/v3/projects/c8a8c23a37f14e73ac69152ccdff73f9/users/23eef4ec58dd4197a7727ce7b1684adc/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:45.041177 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82130a-27ff-4273-873f-23d4299e5c95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a8c23a37f14e73ac69152ccdff73f9, user_id=23eef4ec58dd4197a7727ce7b1684adc, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:45.043930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82130a-27ff-4273-873f-23d4299e5c95 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:45.059080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1140/2286] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:45 2021] PUT /identity/v3/projects/c8a8c23a37f14e73ac69152ccdff73f9/users/23eef4ec58dd4197a7727ce7b1684adc/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:45.069505 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ad2e4-5b44-488d-8b16-4c04f0607046 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:45.069794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ad2e4-5b44-488d-8b16-4c04f0607046 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:45.070062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ad2e4-5b44-488d-8b16-4c04f0607046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:45.102259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-979ad2e4-5b44-488d-8b16-4c04f0607046 None None] MFA Rules not processed for user `23eef4ec58dd4197a7727ce7b1684adc`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:45.103664 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-979ad2e4-5b44-488d-8b16-4c04f0607046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:45.199362 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1147/2287] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:45 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:45.212717 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82130a-27ff-4273-873f-23d4299e5c95 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:45.288418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82130a-27ff-4273-873f-23d4299e5c95 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:45.293497 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55776b-11db-4c02-a001-30fad4934d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:45.294168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55776b-11db-4c02-a001-30fad4934d62 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:45.294448 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55776b-11db-4c02-a001-30fad4934d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:45.294709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55776b-11db-4c02-a001-30fad4934d62 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:45.295549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55776b-11db-4c02-a001-30fad4934d62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:45.297506 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55776b-11db-4c02-a001-30fad4934d62 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:45.329535 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1141/2288] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:45 2021] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:45.334055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ad2e4-5b44-488d-8b16-4c04f0607046 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:45.348322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ad2e4-5b44-488d-8b16-4c04f0607046 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:45.410283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bebef-4e39-4acd-b20b-2eefba221669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:45.410962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bebef-4e39-4acd-b20b-2eefba221669 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:45.411243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bebef-4e39-4acd-b20b-2eefba221669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:45.411517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bebef-4e39-4acd-b20b-2eefba221669 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:45.412235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bebef-4e39-4acd-b20b-2eefba221669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:45.414206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bebef-4e39-4acd-b20b-2eefba221669 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:45.437110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1148/2289] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:45 2021] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:45.441769 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55776b-11db-4c02-a001-30fad4934d62 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:45.453221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55776b-11db-4c02-a001-30fad4934d62 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:45.459188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19e96d-c1ec-441d-a6f0-cb76c3190f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:45.459942 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e96d-c1ec-441d-a6f0-cb76c3190f6c admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:45.460341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e96d-c1ec-441d-a6f0-cb76c3190f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:45.460691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d19e96d-c1ec-441d-a6f0-cb76c3190f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:45.461503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19e96d-c1ec-441d-a6f0-cb76c3190f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:45.463195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d19e96d-c1ec-441d-a6f0-cb76c3190f6c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:45.475726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1142/2290] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:45 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:45.479939 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bebef-4e39-4acd-b20b-2eefba221669 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:45.496794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bebef-4e39-4acd-b20b-2eefba221669 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:45.504094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430c9be-6af5-4dc0-a543-20ae69968e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:45.505642 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430c9be-6af5-4dc0-a543-20ae69968e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:45.506069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430c9be-6af5-4dc0-a543-20ae69968e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:45.506481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430c9be-6af5-4dc0-a543-20ae69968e93 admin admin] PATH_INFO: `/v3/projects/6406d3eee9b34ff2963082b30abaad34/users/0796a31667fd4a3d8c9d662eacc77d02/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:45.527689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430c9be-6af5-4dc0-a543-20ae69968e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6406d3eee9b34ff2963082b30abaad34, user_id=0796a31667fd4a3d8c9d662eacc77d02, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:45.531326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430c9be-6af5-4dc0-a543-20ae69968e93 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:45.547293 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1149/2291] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:45 2021] PUT /identity/v3/projects/6406d3eee9b34ff2963082b30abaad34/users/0796a31667fd4a3d8c9d662eacc77d02/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:45.552934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19e96d-c1ec-441d-a6f0-cb76c3190f6c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:45.563240 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d19e96d-c1ec-441d-a6f0-cb76c3190f6c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:45.626276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3170a-8ea8-47db-9875-a8d163f9a751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:45.627037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3170a-8ea8-47db-9875-a8d163f9a751 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:45.627325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3170a-8ea8-47db-9875-a8d163f9a751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:45.627732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3170a-8ea8-47db-9875-a8d163f9a751 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:45.628467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3170a-8ea8-47db-9875-a8d163f9a751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:45.630114 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3170a-8ea8-47db-9875-a8d163f9a751 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:45.644129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1143/2292] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:45 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:45.646455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430c9be-6af5-4dc0-a543-20ae69968e93 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:45.658135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430c9be-6af5-4dc0-a543-20ae69968e93 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:45.664284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385a4b-d158-4c24-965f-039ed8d5e3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:45.665257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385a4b-d158-4c24-965f-039ed8d5e3aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:45.665534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385a4b-d158-4c24-965f-039ed8d5e3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:45.665795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89385a4b-d158-4c24-965f-039ed8d5e3aa admin admin] PATH_INFO: `/v3/projects/6406d3eee9b34ff2963082b30abaad34/users/0796a31667fd4a3d8c9d662eacc77d02/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:45.667832 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89385a4b-d158-4c24-965f-039ed8d5e3aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6406d3eee9b34ff2963082b30abaad34, user_id=0796a31667fd4a3d8c9d662eacc77d02, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:45.670499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89385a4b-d158-4c24-965f-039ed8d5e3aa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:45.681859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1150/2293] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:45 2021] PUT /identity/v3/projects/6406d3eee9b34ff2963082b30abaad34/users/0796a31667fd4a3d8c9d662eacc77d02/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:45.693737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f6c73-4aeb-4b41-aaf7-7c31384ffa2e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:45.694016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f6c73-4aeb-4b41-aaf7-7c31384ffa2e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:45.694287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f6c73-4aeb-4b41-aaf7-7c31384ffa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:45.722590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-651f6c73-4aeb-4b41-aaf7-7c31384ffa2e None None] MFA Rules not processed for user `0796a31667fd4a3d8c9d662eacc77d02`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:45.723795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-651f6c73-4aeb-4b41-aaf7-7c31384ffa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:45.803978 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1144/2294] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:45 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:45.832008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385a4b-d158-4c24-965f-039ed8d5e3aa admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:45.833972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-89385a4b-d158-4c24-965f-039ed8d5e3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:45.961960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89385a4b-d158-4c24-965f-039ed8d5e3aa admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:45.988390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd144d-12cc-4f7b-aceb-1a4395c8099b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:45.989109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd144d-12cc-4f7b-aceb-1a4395c8099b service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:45.989395 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd144d-12cc-4f7b-aceb-1a4395c8099b service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:45.989668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd144d-12cc-4f7b-aceb-1a4395c8099b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:46.081126 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd144d-12cc-4f7b-aceb-1a4395c8099b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:46.082664 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd144d-12cc-4f7b-aceb-1a4395c8099b service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:46.094796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1151/2295] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:45 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:47.807014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f6c73-4aeb-4b41-aaf7-7c31384ffa2e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:47.817620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f6c73-4aeb-4b41-aaf7-7c31384ffa2e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:47.821707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d3186-9d1d-4f4e-aad6-4aa77f7a8e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:47.822452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d3186-9d1d-4f4e-aad6-4aa77f7a8e41 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:47.822800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d3186-9d1d-4f4e-aad6-4aa77f7a8e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:47.823164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d3186-9d1d-4f4e-aad6-4aa77f7a8e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:47.906994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d3186-9d1d-4f4e-aad6-4aa77f7a8e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:47.908556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d3186-9d1d-4f4e-aad6-4aa77f7a8e41 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:47.937519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1145/2296] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:47 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:50.728037 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd144d-12cc-4f7b-aceb-1a4395c8099b service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:50.741131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd144d-12cc-4f7b-aceb-1a4395c8099b service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:50.747816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398d2bc-2f3b-4eb8-8453-2cb592cb7116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:50.748724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398d2bc-2f3b-4eb8-8453-2cb592cb7116 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:50.749598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398d2bc-2f3b-4eb8-8453-2cb592cb7116 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:50.750913 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398d2bc-2f3b-4eb8-8453-2cb592cb7116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:50.766571 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398d2bc-2f3b-4eb8-8453-2cb592cb7116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:50.769897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398d2bc-2f3b-4eb8-8453-2cb592cb7116 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:50.796256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1152/2297] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:50 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:52.927841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d3186-9d1d-4f4e-aad6-4aa77f7a8e41 service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:52.929574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2d6d3186-9d1d-4f4e-aad6-4aa77f7a8e41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:53.015199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d3186-9d1d-4f4e-aad6-4aa77f7a8e41 service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:53.035675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:53.035675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:53.035675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:53.035675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] PATH_INFO: `/v3/users/c90bb041048043aea8984fb2aa5876d9` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:53.037557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90bb041048043aea8984fb2aa5876d9)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:53.040009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:53.126950 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90bb041048043aea8984fb2aa5876d9'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:53.139112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90bb041048043aea8984fb2aa5876d9'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:53.147761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90bb041048043aea8984fb2aa5876d9'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:53.154859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90bb041048043aea8984fb2aa5876d9'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:53.155534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90bb041048043aea8984fb2aa5876d9'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:53.162058 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1146/2298] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:52 2021] DELETE /identity/v3/users/c90bb041048043aea8984fb2aa5876d9 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:53.166761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996ad84-6beb-4066-853a-c69af93d9f7a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:53.167344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996ad84-6beb-4066-853a-c69af93d9f7a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:53.167344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996ad84-6beb-4066-853a-c69af93d9f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:53.187166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b996ad84-6beb-4066-853a-c69af93d9f7a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:53.188534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b996ad84-6beb-4066-853a-c69af93d9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:53.255059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1153/2299] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:53.266365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:53.269632 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:53.355469 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e101fb2-35ed-4b79-891f-76d301f6bab0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:53.365415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e4e26-90cb-423c-96ea-e4ad0ccf5d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:53.366113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e4e26-90cb-423c-96ea-e4ad0ccf5d0b service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:53.366539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e4e26-90cb-423c-96ea-e4ad0ccf5d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:53.368019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e4e26-90cb-423c-96ea-e4ad0ccf5d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:53.386374 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e4e26-90cb-423c-96ea-e4ad0ccf5d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:53.393975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e4e26-90cb-423c-96ea-e4ad0ccf5d0b service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:53.405838 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1147/2300] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:53.796447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996ad84-6beb-4066-853a-c69af93d9f7a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:53.798078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b996ad84-6beb-4066-853a-c69af93d9f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:53.814802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996ad84-6beb-4066-853a-c69af93d9f7a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:53.823323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:53.824290 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:53.824652 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:53.824934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] PATH_INFO: `/v3/projects/9998924999b94986a7f786981256c256` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:53.826295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9998924999b94986a7f786981256c256)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:53.828636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:53.883677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9998924999b94986a7f786981256c256', 'request_id': 'req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:53.892109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9998924999b94986a7f786981256c256', 'request_id': 'req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:53.898976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9998924999b94986a7f786981256c256', 'request_id': 'req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:53.910024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] The token cache is being invalidate because project 9998924999b94986a7f786981256c256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:53.910644 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:53.910990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fb5283cd-28d4-49bc-a9e9-78cd127f15b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:53.912558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1154/2301] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:53 2021] DELETE /identity/v3/projects/9998924999b94986a7f786981256c256 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:54.885948 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e4e26-90cb-423c-96ea-e4ad0ccf5d0b service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:54.888314 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8b4e4e26-90cb-423c-96ea-e4ad0ccf5d0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:54.902107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e4e26-90cb-423c-96ea-e4ad0ccf5d0b service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:54.964595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:54.965579 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:54.965804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:54.966124 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] PATH_INFO: `/v3/users/5f80ec28714b4664bcdbf53673e85802` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:54.967408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f80ec28714b4664bcdbf53673e85802)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:54.969341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:55.027513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f80ec28714b4664bcdbf53673e85802'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:55.041500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f80ec28714b4664bcdbf53673e85802'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:55.051002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f80ec28714b4664bcdbf53673e85802'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:55.058384 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f80ec28714b4664bcdbf53673e85802'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:55.059159 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f80ec28714b4664bcdbf53673e85802'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:55.066515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1148/2302] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:54 2021] DELETE /identity/v3/users/5f80ec28714b4664bcdbf53673e85802 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:55.071145 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95854c28-0592-41d1-b0cb-c4317472b774 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:55.071624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95854c28-0592-41d1-b0cb-c4317472b774 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:55.071828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95854c28-0592-41d1-b0cb-c4317472b774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:55.091080 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-95854c28-0592-41d1-b0cb-c4317472b774 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:55.092261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-95854c28-0592-41d1-b0cb-c4317472b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:55.153227 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1155/2303] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:55.163873 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:55.165400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:55.222494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bdab5-9e09-4b8e-b0fe-a351ec3cf5cd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:55.226470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fc4fb-4cbd-46f5-bdf5-61715d68a0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:55.227139 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fc4fb-4cbd-46f5-bdf5-61715d68a0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:55.227428 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fc4fb-4cbd-46f5-bdf5-61715d68a0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:55.227705 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fc4fb-4cbd-46f5-bdf5-61715d68a0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:55.237911 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fc4fb-4cbd-46f5-bdf5-61715d68a0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:55.239284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fc4fb-4cbd-46f5-bdf5-61715d68a0b0 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:55.250044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1149/2304] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:55.651297 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95854c28-0592-41d1-b0cb-c4317472b774 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:55.652805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-95854c28-0592-41d1-b0cb-c4317472b774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:55.672226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95854c28-0592-41d1-b0cb-c4317472b774 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:55.686384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:55.687316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:55.687594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:55.687856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] PATH_INFO: `/v3/projects/8b0d64db394f4065a6451fc372b6bf56` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:55.689910 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0d64db394f4065a6451fc372b6bf56)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:55.691865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:55.809944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0d64db394f4065a6451fc372b6bf56', 'request_id': 'req-b0dd1b07-7204-499f-bca8-7c11da19d0b9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:55.823280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0d64db394f4065a6451fc372b6bf56', 'request_id': 'req-b0dd1b07-7204-499f-bca8-7c11da19d0b9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:55.835632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0d64db394f4065a6451fc372b6bf56', 'request_id': 'req-b0dd1b07-7204-499f-bca8-7c11da19d0b9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:55.863526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] The token cache is being invalidate because project 8b0d64db394f4065a6451fc372b6bf56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:55.864268 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:55.866314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:55.869305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1156/2305] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:55 2021] DELETE /identity/v3/projects/8b0d64db394f4065a6451fc372b6bf56 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:55.873827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fc4fb-4cbd-46f5-bdf5-61715d68a0b0 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:55.895810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fc4fb-4cbd-46f5-bdf5-61715d68a0b0 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:56.034683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:56.036316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:56.037013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:56.037206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] PATH_INFO: `/v3/users/23eef4ec58dd4197a7727ce7b1684adc` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:56.039493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=23eef4ec58dd4197a7727ce7b1684adc)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:56.043174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:56.132825 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23eef4ec58dd4197a7727ce7b1684adc'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.151986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23eef4ec58dd4197a7727ce7b1684adc'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.162332 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23eef4ec58dd4197a7727ce7b1684adc'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.171164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23eef4ec58dd4197a7727ce7b1684adc'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.172325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23eef4ec58dd4197a7727ce7b1684adc'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.185512 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1150/2306] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:55 2021] DELETE /identity/v3/users/23eef4ec58dd4197a7727ce7b1684adc => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:56.530322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:56.530322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:56.544548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd1b07-7204-499f-bca8-7c11da19d0b9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:56.608925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:56.609827 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:56.610106 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:56.610380 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] PATH_INFO: `/v3/projects/c8a8c23a37f14e73ac69152ccdff73f9` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:56.612337 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a8c23a37f14e73ac69152ccdff73f9)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:56.614278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:56.674362 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a8c23a37f14e73ac69152ccdff73f9', 'request_id': 'req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.685690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a8c23a37f14e73ac69152ccdff73f9', 'request_id': 'req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.694174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a8c23a37f14e73ac69152ccdff73f9', 'request_id': 'req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.708059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] The token cache is being invalidate because project c8a8c23a37f14e73ac69152ccdff73f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:56.708688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.709565 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.711526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1157/2307] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:56 2021] DELETE /identity/v3/projects/c8a8c23a37f14e73ac69152ccdff73f9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:56.715692 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:56.717366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:56.732959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff85c89-37ad-4a5a-955f-71714a953bbc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:56.768749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:56.770528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:56.815933 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e800b6-a7d1-4fc4-b8d5-46143cb4a155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:56.817039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e800b6-a7d1-4fc4-b8d5-46143cb4a155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:56.817417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e800b6-a7d1-4fc4-b8d5-46143cb4a155 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:56.817697 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e800b6-a7d1-4fc4-b8d5-46143cb4a155 admin admin] PATH_INFO: `/v3/users/0796a31667fd4a3d8c9d662eacc77d02` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:56.819219 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e800b6-a7d1-4fc4-b8d5-46143cb4a155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0796a31667fd4a3d8c9d662eacc77d02)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:56.821215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e800b6-a7d1-4fc4-b8d5-46143cb4a155 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:56.855062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c8a1a-6034-4f00-b73e-4c7d481cc238 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:56.860182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:56.861353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:56.861876 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:56.862210 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] PATH_INFO: `/v3/users/ea2be2585c084e26a3e0fb3a79bd4c95` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:56.863515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2be2585c084e26a3e0fb3a79bd4c95)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:56.866229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:56.895800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-31e800b6-a7d1-4fc4-b8d5-46143cb4a155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0796a31667fd4a3d8c9d662eacc77d02'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.916317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-31e800b6-a7d1-4fc4-b8d5-46143cb4a155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0796a31667fd4a3d8c9d662eacc77d02'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.927934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-31e800b6-a7d1-4fc4-b8d5-46143cb4a155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0796a31667fd4a3d8c9d662eacc77d02'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.928705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2be2585c084e26a3e0fb3a79bd4c95'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.938146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-31e800b6-a7d1-4fc4-b8d5-46143cb4a155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0796a31667fd4a3d8c9d662eacc77d02'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.939498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-31e800b6-a7d1-4fc4-b8d5-46143cb4a155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0796a31667fd4a3d8c9d662eacc77d02'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.942068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2be2585c084e26a3e0fb3a79bd4c95'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.942787 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2be2585c084e26a3e0fb3a79bd4c95'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.946448 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1151/2308] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:56 2021] DELETE /identity/v3/users/0796a31667fd4a3d8c9d662eacc77d02 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:56.950822 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2be2585c084e26a3e0fb3a79bd4c95'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.961742 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2be2585c084e26a3e0fb3a79bd4c95'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:56.969688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1158/2309] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:56 2021] DELETE /identity/v3/users/ea2be2585c084e26a3e0fb3a79bd4c95 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:56.974452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61254-4fc1-4318-b872-7fd394ac3bb3 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:56.974737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61254-4fc1-4318-b872-7fd394ac3bb3 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:56.975174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df61254-4fc1-4318-b872-7fd394ac3bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:56.993507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7df61254-4fc1-4318-b872-7fd394ac3bb3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:56.994711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7df61254-4fc1-4318-b872-7fd394ac3bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:57.082857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1152/2310] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:57.096699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:57.098667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:57.176081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfab8d4-ae51-42ee-940f-058ad56e37fa admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:57.186761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820456b0-73ce-49ef-b517-3925cf049b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:57.187548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820456b0-73ce-49ef-b517-3925cf049b68 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:57.187950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820456b0-73ce-49ef-b517-3925cf049b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:57.188327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820456b0-73ce-49ef-b517-3925cf049b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:57.198949 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820456b0-73ce-49ef-b517-3925cf049b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:57.200701 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820456b0-73ce-49ef-b517-3925cf049b68 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:57.213330 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1159/2311] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:57.287645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df61254-4fc1-4318-b872-7fd394ac3bb3 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:57.289936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7df61254-4fc1-4318-b872-7fd394ac3bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:57.325140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df61254-4fc1-4318-b872-7fd394ac3bb3 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:57.331394 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:57.348031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:57.348527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:57.349652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] PATH_INFO: `/v3/projects/6406d3eee9b34ff2963082b30abaad34` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:57.351216 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6406d3eee9b34ff2963082b30abaad34)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:57.353831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:57.400024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820456b0-73ce-49ef-b517-3925cf049b68 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:57.401649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-820456b0-73ce-49ef-b517-3925cf049b68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:57.414489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6406d3eee9b34ff2963082b30abaad34', 'request_id': 'req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.415601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820456b0-73ce-49ef-b517-3925cf049b68 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:57.426044 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6406d3eee9b34ff2963082b30abaad34', 'request_id': 'req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.436679 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6406d3eee9b34ff2963082b30abaad34', 'request_id': 'req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.450860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] The token cache is being invalidate because project 6406d3eee9b34ff2963082b30abaad34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:57.451145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.451803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f01a6699-194f-4fe8-9e6e-fa8dc9930c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.453726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1153/2312] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:57 2021] DELETE /identity/v3/projects/6406d3eee9b34ff2963082b30abaad34 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:57.459826 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407e5fd-83f1-4f60-86c6-ff72daf083ec None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:57.460179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407e5fd-83f1-4f60-86c6-ff72daf083ec None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:57.461041 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407e5fd-83f1-4f60-86c6-ff72daf083ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:57.483148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:57.484309 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:57.484709 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:57.484884 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] PATH_INFO: `/v3/users/77a5d763d2d848f58fe4f483ad724bd7` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:57.486853 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a5d763d2d848f58fe4f483ad724bd7)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:57.489134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:57.489255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-6407e5fd-83f1-4f60-86c6-ff72daf083ec None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:57.490213 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6407e5fd-83f1-4f60-86c6-ff72daf083ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:57.503032 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1154/2313] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:57.511099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16f93b-0e8a-4b59-a14d-5e6560952c26 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:57.511597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16f93b-0e8a-4b59-a14d-5e6560952c26 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:57.512060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16f93b-0e8a-4b59-a14d-5e6560952c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:57.534620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-ff16f93b-0e8a-4b59-a14d-5e6560952c26 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:57.535893 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ff16f93b-0e8a-4b59-a14d-5e6560952c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:57.545843 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1155/2314] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:49:57.550584 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16f93b-0e8a-4b59-a14d-5e6560952c26 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:57.560075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16f93b-0e8a-4b59-a14d-5e6560952c26 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:57.562108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a5d763d2d848f58fe4f483ad724bd7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.567712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88aca83-2c93-49d7-b351-4eb9d17a50e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:57.568628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88aca83-2c93-49d7-b351-4eb9d17a50e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:57.569000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88aca83-2c93-49d7-b351-4eb9d17a50e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:57.569350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88aca83-2c93-49d7-b351-4eb9d17a50e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:57.570188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88aca83-2c93-49d7-b351-4eb9d17a50e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:57.570594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88aca83-2c93-49d7-b351-4eb9d17a50e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:57.572218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88aca83-2c93-49d7-b351-4eb9d17a50e4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:57.584031 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a5d763d2d848f58fe4f483ad724bd7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.584635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1156/2315] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:57.585518 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a5d763d2d848f58fe4f483ad724bd7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.589097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88aca83-2c93-49d7-b351-4eb9d17a50e4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:57.595784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a5d763d2d848f58fe4f483ad724bd7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.602387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88aca83-2c93-49d7-b351-4eb9d17a50e4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:57.608701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a6cf-449e-4dfc-8655-117f4bc22d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:57.609436 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a5d763d2d848f58fe4f483ad724bd7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.609648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a6cf-449e-4dfc-8655-117f4bc22d4d admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:57.609925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a6cf-449e-4dfc-8655-117f4bc22d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:57.610214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a6cf-449e-4dfc-8655-117f4bc22d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:57.611009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5a6cf-449e-4dfc-8655-117f4bc22d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:57.612926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5a6cf-449e-4dfc-8655-117f4bc22d4d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:57.616717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1160/2316] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:57 2021] DELETE /identity/v3/users/77a5d763d2d848f58fe4f483ad724bd7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:57.644639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1157/2317] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:57 2021] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:49:57.646204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:57.648053 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:57.723739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a6cf-449e-4dfc-8655-117f4bc22d4d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:57.726092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1fd5a6cf-449e-4dfc-8655-117f4bc22d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:57.728997 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16275b4-3890-49fa-8db8-36dbaa589a7f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:57.813945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a6cf-449e-4dfc-8655-117f4bc22d4d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:57.815501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a073b2d-2a85-4c3e-8a3c-cfd7953edd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:57.816606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a073b2d-2a85-4c3e-8a3c-cfd7953edd8d admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:57.817069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a073b2d-2a85-4c3e-8a3c-cfd7953edd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:57.817502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a073b2d-2a85-4c3e-8a3c-cfd7953edd8d admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:57.818376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a073b2d-2a85-4c3e-8a3c-cfd7953edd8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:57.821382 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a073b2d-2a85-4c3e-8a3c-cfd7953edd8d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:57.822637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:57.824983 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:57.825506 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:57.825947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] PATH_INFO: `/v3/projects/1ce56505d55548d89ab635e05756a184` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:57.828107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce56505d55548d89ab635e05756a184)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:57.832035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:57.853335 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1161/2318] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:57 2021] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:57.856547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a073b2d-2a85-4c3e-8a3c-cfd7953edd8d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:57.858589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1a073b2d-2a85-4c3e-8a3c-cfd7953edd8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:57.888965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a073b2d-2a85-4c3e-8a3c-cfd7953edd8d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:57.902377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:57.904013 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:57.904760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:57.905392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] PATH_INFO: `/v3/projects/35dc54b1bebe4180847d1d0b6894612b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:57.907975 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35dc54b1bebe4180847d1d0b6894612b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:57.911925 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:57.921037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce56505d55548d89ab635e05756a184', 'request_id': 'req-dfb6aae7-6c84-4d42-853d-8101a9e0810c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.935797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce56505d55548d89ab635e05756a184', 'request_id': 'req-dfb6aae7-6c84-4d42-853d-8101a9e0810c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.947522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce56505d55548d89ab635e05756a184', 'request_id': 'req-dfb6aae7-6c84-4d42-853d-8101a9e0810c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.964944 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] The token cache is being invalidate because project 1ce56505d55548d89ab635e05756a184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:57.965417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.966414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:57.969804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1158/2319] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:57 2021] DELETE /identity/v3/projects/1ce56505d55548d89ab635e05756a184 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:57.971603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:57.973925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:58.025371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35dc54b1bebe4180847d1d0b6894612b', 'request_id': 'req-1ce00e06-a898-4990-a113-1aa8e818ca28'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.051140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35dc54b1bebe4180847d1d0b6894612b', 'request_id': 'req-1ce00e06-a898-4990-a113-1aa8e818ca28'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.066509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35dc54b1bebe4180847d1d0b6894612b', 'request_id': 'req-1ce00e06-a898-4990-a113-1aa8e818ca28'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.094373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] The token cache is being invalidate because project 35dc54b1bebe4180847d1d0b6894612b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:58.094373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.097867 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.103228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1162/2320] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:57 2021] DELETE /identity/v3/projects/35dc54b1bebe4180847d1d0b6894612b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:58.105169 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:58.108856 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:58.135624 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6aae7-6c84-4d42-853d-8101a9e0810c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:58.226086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce00e06-a898-4990-a113-1aa8e818ca28 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:58.231553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934313f-26fd-4819-b0ff-56dc8a438476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:58.232459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934313f-26fd-4819-b0ff-56dc8a438476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:58.232770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934313f-26fd-4819-b0ff-56dc8a438476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:58.233042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934313f-26fd-4819-b0ff-56dc8a438476 admin admin] PATH_INFO: `/v3/users/ff73929bab914eda8e535e0f82c11de6` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:58.234308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934313f-26fd-4819-b0ff-56dc8a438476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff73929bab914eda8e535e0f82c11de6)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:58.236348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934313f-26fd-4819-b0ff-56dc8a438476 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:58.252163 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e5c09-f16e-4d40-9068-5d81f29595a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:58.252808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e5c09-f16e-4d40-9068-5d81f29595a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:58.253089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e5c09-f16e-4d40-9068-5d81f29595a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:58.253366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e5c09-f16e-4d40-9068-5d81f29595a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:58.255095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e5c09-f16e-4d40-9068-5d81f29595a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:58.255965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e5c09-f16e-4d40-9068-5d81f29595a1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:58.278174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1159/2321] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:57 2021] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:58.282520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e5c09-f16e-4d40-9068-5d81f29595a1 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:58.285092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-710e5c09-f16e-4d40-9068-5d81f29595a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:58.298684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d934313f-26fd-4819-b0ff-56dc8a438476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff73929bab914eda8e535e0f82c11de6'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.301103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e5c09-f16e-4d40-9068-5d81f29595a1 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:58.307142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f9d4b-a2ac-4b04-9ebe-9f036ceee98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:58.307961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9d4b-a2ac-4b04-9ebe-9f036ceee98e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:58.308335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9d4b-a2ac-4b04-9ebe-9f036ceee98e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:58.308748 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f9d4b-a2ac-4b04-9ebe-9f036ceee98e admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:58.309598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f9d4b-a2ac-4b04-9ebe-9f036ceee98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:58.311330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f9d4b-a2ac-4b04-9ebe-9f036ceee98e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:58.312316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d934313f-26fd-4819-b0ff-56dc8a438476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff73929bab914eda8e535e0f82c11de6'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.313234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d934313f-26fd-4819-b0ff-56dc8a438476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff73929bab914eda8e535e0f82c11de6'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.322796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1160/2322] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:58 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:58.327520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d934313f-26fd-4819-b0ff-56dc8a438476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff73929bab914eda8e535e0f82c11de6'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.331378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f9d4b-a2ac-4b04-9ebe-9f036ceee98e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:58.342714 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-d934313f-26fd-4819-b0ff-56dc8a438476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff73929bab914eda8e535e0f82c11de6'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.345186 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f9d4b-a2ac-4b04-9ebe-9f036ceee98e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:58.350546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808a3ec-58f1-465a-b58a-4a2edf321637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:58.351682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808a3ec-58f1-465a-b58a-4a2edf321637 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:58.351794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808a3ec-58f1-465a-b58a-4a2edf321637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:58.351940 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1163/2323] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:58 2021] DELETE /identity/v3/users/ff73929bab914eda8e535e0f82c11de6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:58.352365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808a3ec-58f1-465a-b58a-4a2edf321637 admin admin] PATH_INFO: `/v3/projects/37ee76160c814e90bffcc2b3c4c54446/users/f9e1ef65024342fd98733231d828d2c8/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:58.377791 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808a3ec-58f1-465a-b58a-4a2edf321637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ee76160c814e90bffcc2b3c4c54446, user_id=f9e1ef65024342fd98733231d828d2c8, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:58.381284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808a3ec-58f1-465a-b58a-4a2edf321637 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:58.401809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1161/2324] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:58 2021] PUT /identity/v3/projects/37ee76160c814e90bffcc2b3c4c54446/users/f9e1ef65024342fd98733231d828d2c8/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:58.418825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d834f4e-b16b-42c5-9440-d3acd5a4dc79 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:58.419118 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d834f4e-b16b-42c5-9440-d3acd5a4dc79 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:58.419391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d834f4e-b16b-42c5-9440-d3acd5a4dc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:58.454463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-6d834f4e-b16b-42c5-9440-d3acd5a4dc79 None None] MFA Rules not processed for user `f9e1ef65024342fd98733231d828d2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:58.455902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6d834f4e-b16b-42c5-9440-d3acd5a4dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:58.535755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1164/2325] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:58 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:58.548669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808a3ec-58f1-465a-b58a-4a2edf321637 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:58.550576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1808a3ec-58f1-465a-b58a-4a2edf321637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:58.578787 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d834f4e-b16b-42c5-9440-d3acd5a4dc79 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:58.580379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6d834f4e-b16b-42c5-9440-d3acd5a4dc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:58.641168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808a3ec-58f1-465a-b58a-4a2edf321637 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:58.645363 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151276b-e6ee-4a43-ab0d-8d60cf09aa36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18f1422ce48e44ab85e6d5e10d1ea898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:58.646056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151276b-e6ee-4a43-ab0d-8d60cf09aa36 service glance] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:58.646339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151276b-e6ee-4a43-ab0d-8d60cf09aa36 service glance] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:58.646616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151276b-e6ee-4a43-ab0d-8d60cf09aa36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:58.655133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d834f4e-b16b-42c5-9440-d3acd5a4dc79 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:58.661030 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:58.662226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151276b-e6ee-4a43-ab0d-8d60cf09aa36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:58.662373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:58.662555 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:58.664713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] PATH_INFO: `/v3/projects/5f1c54d0ed6f4fd790c45b416e9910c9` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:58.664835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151276b-e6ee-4a43-ab0d-8d60cf09aa36 service glance] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:58.664931 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1c54d0ed6f4fd790c45b416e9910c9)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:58.667965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:58.674173 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1162/2326] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:58 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:58.720952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1c54d0ed6f4fd790c45b416e9910c9', 'request_id': 'req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.730304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1c54d0ed6f4fd790c45b416e9910c9', 'request_id': 'req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.738468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1c54d0ed6f4fd790c45b416e9910c9', 'request_id': 'req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.749759 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] The token cache is being invalidate because project 5f1c54d0ed6f4fd790c45b416e9910c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:49:58.750180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.750908 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9cb345c5-5fea-4ec9-b480-cd22cea4b08d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:58.757133 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1165/2327] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:49:58 2021] DELETE /identity/v3/projects/5f1c54d0ed6f4fd790c45b416e9910c9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:49:58.758711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfad5-59ca-4b28-8d53-fde3c0628a40 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:58.758906 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfad5-59ca-4b28-8d53-fde3c0628a40 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:58.759164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfad5-59ca-4b28-8d53-fde3c0628a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:58.779351 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c55cfad5-59ca-4b28-8d53-fde3c0628a40 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:58.780546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c55cfad5-59ca-4b28-8d53-fde3c0628a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:58.846921 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1163/2328] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:58.855110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a4b1-5f33-4e2c-b1ca-c0558e674fea None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:58.855396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a4b1-5f33-4e2c-b1ca-c0558e674fea None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:58.855679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427a4b1-5f33-4e2c-b1ca-c0558e674fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:58.875561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e427a4b1-5f33-4e2c-b1ca-c0558e674fea None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:58.877451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e427a4b1-5f33-4e2c-b1ca-c0558e674fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:58.885869 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1166/2329] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:58.890060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cfad5-59ca-4b28-8d53-fde3c0628a40 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:58.900605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cfad5-59ca-4b28-8d53-fde3c0628a40 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:58.905522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2944792-a8c5-4173-ba5d-4365248b3be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:58.906192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2944792-a8c5-4173-ba5d-4365248b3be4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:58.906470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2944792-a8c5-4173-ba5d-4365248b3be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:58.906741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2944792-a8c5-4173-ba5d-4365248b3be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:58.907570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2944792-a8c5-4173-ba5d-4365248b3be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:49:58.908596 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2944792-a8c5-4173-ba5d-4365248b3be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:58.910233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2944792-a8c5-4173-ba5d-4365248b3be4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:58.922115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1164/2330] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:49:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:49:58.927504 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a4b1-5f33-4e2c-b1ca-c0558e674fea None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:58.936824 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427a4b1-5f33-4e2c-b1ca-c0558e674fea None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:58.942187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31c8a7-a9da-4b78-b66c-840572a4127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:58.942855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31c8a7-a9da-4b78-b66c-840572a4127d admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:58.943171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31c8a7-a9da-4b78-b66c-840572a4127d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:58.943434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31c8a7-a9da-4b78-b66c-840572a4127d admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:58.944178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31c8a7-a9da-4b78-b66c-840572a4127d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:58.946129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31c8a7-a9da-4b78-b66c-840572a4127d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:58.975840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1167/2331] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:49:58 2021] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:58.980241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2944792-a8c5-4173-ba5d-4365248b3be4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:58.992441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2944792-a8c5-4173-ba5d-4365248b3be4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:59.061902 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3488d9-fe39-4d84-acd5-dbeec9b4d99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:59.062703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3488d9-fe39-4d84-acd5-dbeec9b4d99d admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:59.063035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3488d9-fe39-4d84-acd5-dbeec9b4d99d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:59.063414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3488d9-fe39-4d84-acd5-dbeec9b4d99d admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:59.065203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3488d9-fe39-4d84-acd5-dbeec9b4d99d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:59.070458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3488d9-fe39-4d84-acd5-dbeec9b4d99d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:59.104115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1165/2332] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:49:58 2021] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:49:59.105267 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31c8a7-a9da-4b78-b66c-840572a4127d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:59.120680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31c8a7-a9da-4b78-b66c-840572a4127d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:59.140190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56d055-7c8e-4910-838f-b130c0d2e4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:59.141288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56d055-7c8e-4910-838f-b130c0d2e4bf admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:59.141588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56d055-7c8e-4910-838f-b130c0d2e4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:59.142110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56d055-7c8e-4910-838f-b130c0d2e4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:59.142976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56d055-7c8e-4910-838f-b130c0d2e4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:59.144718 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56d055-7c8e-4910-838f-b130c0d2e4bf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:59.157563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1168/2333] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:59 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:59.162047 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3488d9-fe39-4d84-acd5-dbeec9b4d99d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:59.182178 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3488d9-fe39-4d84-acd5-dbeec9b4d99d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:59.182357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37399d-ffae-47a1-bce2-24f76565969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:59.183078 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37399d-ffae-47a1-bce2-24f76565969a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:59.183412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37399d-ffae-47a1-bce2-24f76565969a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:59.183745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37399d-ffae-47a1-bce2-24f76565969a admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:59.184552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37399d-ffae-47a1-bce2-24f76565969a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:59.186255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37399d-ffae-47a1-bce2-24f76565969a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:59.204195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1166/2334] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:49:59 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:49:59.208840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56d055-7c8e-4910-838f-b130c0d2e4bf admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:59.219854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56d055-7c8e-4910-838f-b130c0d2e4bf admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:59.225225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b301b-d003-4436-8adb-4037850a6a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:59.226289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b301b-d003-4436-8adb-4037850a6a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:59.226651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b301b-d003-4436-8adb-4037850a6a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:59.227004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b301b-d003-4436-8adb-4037850a6a78 admin admin] PATH_INFO: `/v3/projects/8632e7a853ca4b5d909f05bd931c5efd/users/b5897e4479404b6da7753418bfecbc2d/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:59.243506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b301b-d003-4436-8adb-4037850a6a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8632e7a853ca4b5d909f05bd931c5efd, user_id=b5897e4479404b6da7753418bfecbc2d, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:59.246458 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b301b-d003-4436-8adb-4037850a6a78 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:59.260559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1169/2335] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:49:59 2021] PUT /identity/v3/projects/8632e7a853ca4b5d909f05bd931c5efd/users/b5897e4479404b6da7753418bfecbc2d/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:59.273623 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da9819-2069-4c88-bd27-d34943596ed0 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:59.274135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da9819-2069-4c88-bd27-d34943596ed0 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:59.274532 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da9819-2069-4c88-bd27-d34943596ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:59.306480 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-79da9819-2069-4c88-bd27-d34943596ed0 None None] MFA Rules not processed for user `b5897e4479404b6da7753418bfecbc2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:59.307774 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-79da9819-2069-4c88-bd27-d34943596ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:59.389682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1167/2336] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:59 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:59.400515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b301b-d003-4436-8adb-4037850a6a78 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:59.402259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-de3b301b-d003-4436-8adb-4037850a6a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:59.464864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b301b-d003-4436-8adb-4037850a6a78 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:59.468690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790314be-1eaa-47b9-8206-3349b1d8d977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:59.469338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790314be-1eaa-47b9-8206-3349b1d8d977 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:59.469883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790314be-1eaa-47b9-8206-3349b1d8d977 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:59.469883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790314be-1eaa-47b9-8206-3349b1d8d977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:59.481407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790314be-1eaa-47b9-8206-3349b1d8d977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:59.482860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790314be-1eaa-47b9-8206-3349b1d8d977 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:59.493344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1170/2337] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:59 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:49:59.521333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da9819-2069-4c88-bd27-d34943596ed0 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:59.592598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da9819-2069-4c88-bd27-d34943596ed0 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:59.598144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:59.599087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:59.599373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:59.599797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] PATH_INFO: `/v3/users/b5897e4479404b6da7753418bfecbc2d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:59.601547 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5897e4479404b6da7753418bfecbc2d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:59.603763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:59.662407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5897e4479404b6da7753418bfecbc2d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:59.675125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5897e4479404b6da7753418bfecbc2d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:59.683669 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5897e4479404b6da7753418bfecbc2d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:59.691873 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5897e4479404b6da7753418bfecbc2d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:59.692619 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5897e4479404b6da7753418bfecbc2d'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:49:59.699462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1168/2338] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:49:59 2021] DELETE /identity/v3/users/b5897e4479404b6da7753418bfecbc2d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:49:59.704203 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3a90-fcb4-4fa3-86f0-3d4aa12a5521 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:59.704719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3a90-fcb4-4fa3-86f0-3d4aa12a5521 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:59.704811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b3a90-fcb4-4fa3-86f0-3d4aa12a5521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:59.729201 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-669b3a90-fcb4-4fa3-86f0-3d4aa12a5521 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:49:59.730685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-669b3a90-fcb4-4fa3-86f0-3d4aa12a5521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:59.807417 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1171/2339] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:49:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:49:59.821634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:49:59.824004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:49:59.888622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82620e4b-874b-415f-91dc-6bed1b1b9005 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:49:59.895720 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb66389-1e1c-455d-b400-29e509448aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:49:59.896394 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66389-1e1c-455d-b400-29e509448aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:49:59.896703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66389-1e1c-455d-b400-29e509448aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:49:59.896963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb66389-1e1c-455d-b400-29e509448aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:49:59.906873 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb66389-1e1c-455d-b400-29e509448aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:49:59.908775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb66389-1e1c-455d-b400-29e509448aa3 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:49:59.919260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1169/2340] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:49:59 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:00.225801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b3a90-fcb4-4fa3-86f0-3d4aa12a5521 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:00.227324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-669b3a90-fcb4-4fa3-86f0-3d4aa12a5521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:00.242826 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b3a90-fcb4-4fa3-86f0-3d4aa12a5521 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:00.251016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:00.252946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:00.253415 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:00.254101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] PATH_INFO: `/v3/projects/8632e7a853ca4b5d909f05bd931c5efd` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:00.257136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8632e7a853ca4b5d909f05bd931c5efd)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:00.259278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:00.320580 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8632e7a853ca4b5d909f05bd931c5efd', 'request_id': 'req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:00.332598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8632e7a853ca4b5d909f05bd931c5efd', 'request_id': 'req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:00.346845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8632e7a853ca4b5d909f05bd931c5efd', 'request_id': 'req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:00.359028 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] The token cache is being invalidate because project 8632e7a853ca4b5d909f05bd931c5efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:50:00.359350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:00.359988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-3a6d5d18-d3f6-435c-a7e8-fedc501a25d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:00.361901 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1172/2341] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:50:00 2021] DELETE /identity/v3/projects/8632e7a853ca4b5d909f05bd931c5efd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:00.368599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172826-905c-4257-a21a-80ad61162108 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:00.369089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172826-905c-4257-a21a-80ad61162108 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:00.369203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a172826-905c-4257-a21a-80ad61162108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:00.390018 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-8a172826-905c-4257-a21a-80ad61162108 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:00.391207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8a172826-905c-4257-a21a-80ad61162108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:00.466070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1170/2342] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:00.474501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5d020-76ad-4153-b91e-bb60a776f8e1 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:00.474779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5d020-76ad-4153-b91e-bb60a776f8e1 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:00.475058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5d020-76ad-4153-b91e-bb60a776f8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:00.495970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-dcb5d020-76ad-4153-b91e-bb60a776f8e1 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:00.497195 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-dcb5d020-76ad-4153-b91e-bb60a776f8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:00.505565 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1173/2343] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:00.510543 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a172826-905c-4257-a21a-80ad61162108 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:00.520682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a172826-905c-4257-a21a-80ad61162108 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:00.526385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cebb7-f0fa-4642-964f-991f14de96d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:00.527061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cebb7-f0fa-4642-964f-991f14de96d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:00.527345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cebb7-f0fa-4642-964f-991f14de96d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:00.527615 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033cebb7-f0fa-4642-964f-991f14de96d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:00.528393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cebb7-f0fa-4642-964f-991f14de96d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:50:00.528750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cebb7-f0fa-4642-964f-991f14de96d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:00.530665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033cebb7-f0fa-4642-964f-991f14de96d9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:00.545970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1171/2344] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:50:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:50:00.551604 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5d020-76ad-4153-b91e-bb60a776f8e1 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:00.561616 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5d020-76ad-4153-b91e-bb60a776f8e1 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:00.567535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c998e2b-2d3f-4dad-9a84-f1551e9d6c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:00.568234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998e2b-2d3f-4dad-9a84-f1551e9d6c13 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:00.568513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998e2b-2d3f-4dad-9a84-f1551e9d6c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:00.568813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c998e2b-2d3f-4dad-9a84-f1551e9d6c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:00.569538 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c998e2b-2d3f-4dad-9a84-f1551e9d6c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:00.571520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c998e2b-2d3f-4dad-9a84-f1551e9d6c13 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:00.606190 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1174/2345] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:50:00 2021] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:50:00.610022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cebb7-f0fa-4642-964f-991f14de96d9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:00.621401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033cebb7-f0fa-4642-964f-991f14de96d9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:00.683385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8841c2-132c-4abb-a4c3-3c0b3c13f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:00.684249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8841c2-132c-4abb-a4c3-3c0b3c13f9bc admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:00.684539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8841c2-132c-4abb-a4c3-3c0b3c13f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:00.684836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8841c2-132c-4abb-a4c3-3c0b3c13f9bc admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:00.685543 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8841c2-132c-4abb-a4c3-3c0b3c13f9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:00.687507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8841c2-132c-4abb-a4c3-3c0b3c13f9bc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:00.711691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1172/2346] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:50:00 2021] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:50:00.717317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c998e2b-2d3f-4dad-9a84-f1551e9d6c13 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:00.731229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c998e2b-2d3f-4dad-9a84-f1551e9d6c13 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:00.738946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f1491-c5cf-47f6-8483-cbd53fd4d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:00.739774 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f1491-c5cf-47f6-8483-cbd53fd4d96d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:00.740126 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f1491-c5cf-47f6-8483-cbd53fd4d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:00.740466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f1491-c5cf-47f6-8483-cbd53fd4d96d admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:00.741338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f1491-c5cf-47f6-8483-cbd53fd4d96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:00.743016 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562f1491-c5cf-47f6-8483-cbd53fd4d96d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:00.755299 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1175/2347] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:50:00 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:50:00.759432 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8841c2-132c-4abb-a4c3-3c0b3c13f9bc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:00.770375 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8841c2-132c-4abb-a4c3-3c0b3c13f9bc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:00.775369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b859b-ba77-4df8-961a-746a8e2a3440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:00.776049 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b859b-ba77-4df8-961a-746a8e2a3440 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:00.776335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b859b-ba77-4df8-961a-746a8e2a3440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:00.776652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b859b-ba77-4df8-961a-746a8e2a3440 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:00.777392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b859b-ba77-4df8-961a-746a8e2a3440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:00.779019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b859b-ba77-4df8-961a-746a8e2a3440 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:00.792611 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1173/2348] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:50:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:50:00.794266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f1491-c5cf-47f6-8483-cbd53fd4d96d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:00.807703 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f1491-c5cf-47f6-8483-cbd53fd4d96d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:00.812751 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d6e82-1871-474f-a5b3-841e3b7942aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:00.813652 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6e82-1871-474f-a5b3-841e3b7942aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:00.813932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6e82-1871-474f-a5b3-841e3b7942aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:00.814237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d6e82-1871-474f-a5b3-841e3b7942aa admin admin] PATH_INFO: `/v3/projects/9b39005c50bb49ca98d24f075a1a72ff/users/fa48a5a7fa6a47468da9e4405c76c6ae/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:00.829637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d6e82-1871-474f-a5b3-841e3b7942aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b39005c50bb49ca98d24f075a1a72ff, user_id=fa48a5a7fa6a47468da9e4405c76c6ae, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:00.832269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d6e82-1871-474f-a5b3-841e3b7942aa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:00.847234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1176/2349] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:50:00 2021] PUT /identity/v3/projects/9b39005c50bb49ca98d24f075a1a72ff/users/fa48a5a7fa6a47468da9e4405c76c6ae/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:00.857654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326941b3-9a24-40b2-bc00-88af44526620 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:00.858051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326941b3-9a24-40b2-bc00-88af44526620 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:00.858232 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326941b3-9a24-40b2-bc00-88af44526620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:00.888375 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-326941b3-9a24-40b2-bc00-88af44526620 None None] MFA Rules not processed for user `fa48a5a7fa6a47468da9e4405c76c6ae`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:00.889797 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-326941b3-9a24-40b2-bc00-88af44526620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:00.963162 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1174/2350] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:00 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:00.985912 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d6e82-1871-474f-a5b3-841e3b7942aa admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:00.988888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9f7d6e82-1871-474f-a5b3-841e3b7942aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:01.058875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d6e82-1871-474f-a5b3-841e3b7942aa admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:01.062625 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d45a7-ce58-49a4-b04b-6e37e820e8c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:01.063289 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d45a7-ce58-49a4-b04b-6e37e820e8c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:01.063564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d45a7-ce58-49a4-b04b-6e37e820e8c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:01.063897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d45a7-ce58-49a4-b04b-6e37e820e8c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:01.072705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d45a7-ce58-49a4-b04b-6e37e820e8c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:01.074228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d45a7-ce58-49a4-b04b-6e37e820e8c6 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:01.085180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1177/2351] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:00 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:09.586657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326941b3-9a24-40b2-bc00-88af44526620 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:09.652860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326941b3-9a24-40b2-bc00-88af44526620 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:09.657951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:09.658844 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:09.659153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:09.659421 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] PATH_INFO: `/v3/users/fa48a5a7fa6a47468da9e4405c76c6ae` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:09.660684 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa48a5a7fa6a47468da9e4405c76c6ae)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:09.662560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:09.713529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa48a5a7fa6a47468da9e4405c76c6ae'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:09.725187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa48a5a7fa6a47468da9e4405c76c6ae'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:09.734920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa48a5a7fa6a47468da9e4405c76c6ae'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:09.742642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa48a5a7fa6a47468da9e4405c76c6ae'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:09.743361 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa48a5a7fa6a47468da9e4405c76c6ae'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:09.749781 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1175/2352] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:50:09 2021] DELETE /identity/v3/users/fa48a5a7fa6a47468da9e4405c76c6ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:09.754600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6900cd-9433-4c4f-a56b-175c4c505023 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:09.755131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6900cd-9433-4c4f-a56b-175c4c505023 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:09.755131 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6900cd-9433-4c4f-a56b-175c4c505023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:09.773643 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9d6900cd-9433-4c4f-a56b-175c4c505023 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:09.774844 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9d6900cd-9433-4c4f-a56b-175c4c505023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:09.838991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1178/2353] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:09.849183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:09.850711 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:09.908378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cb09c-5a9e-48ce-9d4b-f2e822df39dc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:09.912034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c504b1d-55d1-4fa0-9986-a06dae839b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:09.912718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504b1d-55d1-4fa0-9986-a06dae839b3c service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:09.912998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504b1d-55d1-4fa0-9986-a06dae839b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:09.913270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504b1d-55d1-4fa0-9986-a06dae839b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:09.922175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c504b1d-55d1-4fa0-9986-a06dae839b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:09.924112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c504b1d-55d1-4fa0-9986-a06dae839b3c service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:09.934173 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1176/2354] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:10.223257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6900cd-9433-4c4f-a56b-175c4c505023 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:10.224962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9d6900cd-9433-4c4f-a56b-175c4c505023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:10.240252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6900cd-9433-4c4f-a56b-175c4c505023 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:10.246359 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:10.247273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:10.247609 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:10.248037 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] PATH_INFO: `/v3/projects/9b39005c50bb49ca98d24f075a1a72ff` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:10.249698 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b39005c50bb49ca98d24f075a1a72ff)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:10.254813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:10.301843 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b39005c50bb49ca98d24f075a1a72ff', 'request_id': 'req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:10.311334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b39005c50bb49ca98d24f075a1a72ff', 'request_id': 'req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:10.318426 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b39005c50bb49ca98d24f075a1a72ff', 'request_id': 'req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:10.329791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] The token cache is being invalidate because project 9b39005c50bb49ca98d24f075a1a72ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:50:10.330094 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:10.330750 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7bfdb9cf-8f58-421a-aa61-ba5d2321b0c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:10.332537 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1179/2355] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:50:10 2021] DELETE /identity/v3/projects/9b39005c50bb49ca98d24f075a1a72ff => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:10.338880 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ced970-d080-47d4-93dc-1811a6922b1b None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:10.339197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ced970-d080-47d4-93dc-1811a6922b1b None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:10.339468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ced970-d080-47d4-93dc-1811a6922b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:10.358633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-98ced970-d080-47d4-93dc-1811a6922b1b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:10.359731 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-98ced970-d080-47d4-93dc-1811a6922b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:10.431690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1177/2356] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:10.445734 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668b07f-a270-421f-8a9c-d4ba70d62bb9 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:10.446018 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668b07f-a270-421f-8a9c-d4ba70d62bb9 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:10.446320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668b07f-a270-421f-8a9c-d4ba70d62bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:10.467162 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-0668b07f-a270-421f-8a9c-d4ba70d62bb9 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:10.468398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0668b07f-a270-421f-8a9c-d4ba70d62bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:10.477966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1180/2357] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:10.482586 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ced970-d080-47d4-93dc-1811a6922b1b None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:10.493562 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ced970-d080-47d4-93dc-1811a6922b1b None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:10.500561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03768db-aa30-40a1-a4d7-85b5e6222904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:10.502079 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03768db-aa30-40a1-a4d7-85b5e6222904 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:10.502414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03768db-aa30-40a1-a4d7-85b5e6222904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:10.502772 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03768db-aa30-40a1-a4d7-85b5e6222904 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:10.503612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03768db-aa30-40a1-a4d7-85b5e6222904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:50:10.503980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03768db-aa30-40a1-a4d7-85b5e6222904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:10.505751 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03768db-aa30-40a1-a4d7-85b5e6222904 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:10.520034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1178/2358] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:50:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:50:10.525979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668b07f-a270-421f-8a9c-d4ba70d62bb9 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:10.541943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668b07f-a270-421f-8a9c-d4ba70d62bb9 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:10.548023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276d75-3317-4e95-86a6-834a3f008afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:10.548739 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276d75-3317-4e95-86a6-834a3f008afc admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:10.549069 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276d75-3317-4e95-86a6-834a3f008afc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:10.549282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93276d75-3317-4e95-86a6-834a3f008afc admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:10.550020 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93276d75-3317-4e95-86a6-834a3f008afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:10.551936 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93276d75-3317-4e95-86a6-834a3f008afc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:10.586894 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1181/2359] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:50:10 2021] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:50:10.590820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03768db-aa30-40a1-a4d7-85b5e6222904 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:10.603661 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03768db-aa30-40a1-a4d7-85b5e6222904 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:10.674542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5efb3-05df-457b-8514-8198eb898213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:10.674542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5efb3-05df-457b-8514-8198eb898213 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:10.674542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5efb3-05df-457b-8514-8198eb898213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:10.674996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5efb3-05df-457b-8514-8198eb898213 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:10.675694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5efb3-05df-457b-8514-8198eb898213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:10.679245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5efb3-05df-457b-8514-8198eb898213 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:10.708185 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1179/2360] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:50:10 2021] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:50:10.709607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276d75-3317-4e95-86a6-834a3f008afc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:10.722163 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93276d75-3317-4e95-86a6-834a3f008afc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:10.730003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd81159-80eb-420b-9a6e-729aaeb84f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:10.730689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd81159-80eb-420b-9a6e-729aaeb84f76 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:10.731023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd81159-80eb-420b-9a6e-729aaeb84f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:10.731219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd81159-80eb-420b-9a6e-729aaeb84f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:10.732019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd81159-80eb-420b-9a6e-729aaeb84f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:10.733650 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd81159-80eb-420b-9a6e-729aaeb84f76 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:10.748139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1182/2361] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:50:10 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:50:10.752440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5efb3-05df-457b-8514-8198eb898213 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:10.763431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5efb3-05df-457b-8514-8198eb898213 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:10.768355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7b76d-63d6-48a2-bcce-70ff1a91464a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:10.769030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b76d-63d6-48a2-bcce-70ff1a91464a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:10.769325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b76d-63d6-48a2-bcce-70ff1a91464a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:10.769567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7b76d-63d6-48a2-bcce-70ff1a91464a admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:10.770335 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7b76d-63d6-48a2-bcce-70ff1a91464a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:10.771896 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7b76d-63d6-48a2-bcce-70ff1a91464a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:10.783683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1180/2362] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:50:10 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:50:10.788011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd81159-80eb-420b-9a6e-729aaeb84f76 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:10.800705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd81159-80eb-420b-9a6e-729aaeb84f76 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:10.805464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307270e-9d1b-4056-9a06-11a83e85541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:10.806356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307270e-9d1b-4056-9a06-11a83e85541f admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:10.806641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307270e-9d1b-4056-9a06-11a83e85541f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:10.806915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f307270e-9d1b-4056-9a06-11a83e85541f admin admin] PATH_INFO: `/v3/projects/29eacbeffc01480fa5900500c94106c5/users/beb3d053ef0a49b1b4cfadd3be9231c6/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:10.823887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307270e-9d1b-4056-9a06-11a83e85541f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29eacbeffc01480fa5900500c94106c5, user_id=beb3d053ef0a49b1b4cfadd3be9231c6, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:10.827583 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f307270e-9d1b-4056-9a06-11a83e85541f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:10.842466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1183/2363] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:50:10 2021] PUT /identity/v3/projects/29eacbeffc01480fa5900500c94106c5/users/beb3d053ef0a49b1b4cfadd3be9231c6/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:50:10.855061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b67a-e2a9-461b-a98d-43f4bbbfd0ac None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:10.855494 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b67a-e2a9-461b-a98d-43f4bbbfd0ac None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:10.855779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62b67a-e2a9-461b-a98d-43f4bbbfd0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:10.891645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-cb62b67a-e2a9-461b-a98d-43f4bbbfd0ac None None] MFA Rules not processed for user `beb3d053ef0a49b1b4cfadd3be9231c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:10.893455 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-cb62b67a-e2a9-461b-a98d-43f4bbbfd0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:10.995703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1181/2364] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:10 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:11.008435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307270e-9d1b-4056-9a06-11a83e85541f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:11.011356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f307270e-9d1b-4056-9a06-11a83e85541f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:11.087112 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f307270e-9d1b-4056-9a06-11a83e85541f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:11.095150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddc7ca-4384-4904-ba9a-725630380b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:11.096327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddc7ca-4384-4904-ba9a-725630380b41 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:11.096733 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddc7ca-4384-4904-ba9a-725630380b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:11.097049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddc7ca-4384-4904-ba9a-725630380b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:11.107082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddc7ca-4384-4904-ba9a-725630380b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:11.108864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddc7ca-4384-4904-ba9a-725630380b41 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:11.118590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1184/2365] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:11 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:11.146705 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62b67a-e2a9-461b-a98d-43f4bbbfd0ac None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:11.209435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62b67a-e2a9-461b-a98d-43f4bbbfd0ac None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:11.215490 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:11.216180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:11.216444 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:11.216975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] PATH_INFO: `/v3/users/beb3d053ef0a49b1b4cfadd3be9231c6` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:11.218061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb3d053ef0a49b1b4cfadd3be9231c6)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:11.220273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:11.270175 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb3d053ef0a49b1b4cfadd3be9231c6'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:11.285143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb3d053ef0a49b1b4cfadd3be9231c6'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:11.294082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb3d053ef0a49b1b4cfadd3be9231c6'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:11.301850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb3d053ef0a49b1b4cfadd3be9231c6'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:11.302527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb3d053ef0a49b1b4cfadd3be9231c6'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:11.308435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1182/2366] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:50:11 2021] DELETE /identity/v3/users/beb3d053ef0a49b1b4cfadd3be9231c6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:11.314435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38bb0c-aa21-493b-9255-855bd3a892a0 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:11.315004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38bb0c-aa21-493b-9255-855bd3a892a0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:11.315691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38bb0c-aa21-493b-9255-855bd3a892a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:11.343665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-bc38bb0c-aa21-493b-9255-855bd3a892a0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:11.345686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bc38bb0c-aa21-493b-9255-855bd3a892a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:11.406994 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1185/2367] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:11.417067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:11.418510 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:11.476693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994b275-ca88-4f48-9b1e-372dd16acff0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:11.481027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc29bc-13a2-4249-9ba7-5b03b04c3023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:11.481678 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc29bc-13a2-4249-9ba7-5b03b04c3023 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:11.481959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc29bc-13a2-4249-9ba7-5b03b04c3023 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:11.482233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc29bc-13a2-4249-9ba7-5b03b04c3023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:11.492943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc29bc-13a2-4249-9ba7-5b03b04c3023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:11.494392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfc29bc-13a2-4249-9ba7-5b03b04c3023 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:11.505082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1183/2368] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:11.787223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38bb0c-aa21-493b-9255-855bd3a892a0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:11.788777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bc38bb0c-aa21-493b-9255-855bd3a892a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:11.803481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38bb0c-aa21-493b-9255-855bd3a892a0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:11.810063 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:11.810978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:11.820301 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:11.820842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] PATH_INFO: `/v3/projects/29eacbeffc01480fa5900500c94106c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:11.822375 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29eacbeffc01480fa5900500c94106c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:11.824482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:11.879434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29eacbeffc01480fa5900500c94106c5', 'request_id': 'req-a390351f-3995-4825-835e-ed1842e60657'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:11.887785 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29eacbeffc01480fa5900500c94106c5', 'request_id': 'req-a390351f-3995-4825-835e-ed1842e60657'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:11.894178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29eacbeffc01480fa5900500c94106c5', 'request_id': 'req-a390351f-3995-4825-835e-ed1842e60657'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:11.903985 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] The token cache is being invalidate because project 29eacbeffc01480fa5900500c94106c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:50:11.904265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:11.904899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-a390351f-3995-4825-835e-ed1842e60657 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:11.906421 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1186/2369] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:50:11 2021] DELETE /identity/v3/projects/29eacbeffc01480fa5900500c94106c5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:19.018286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc29bc-13a2-4249-9ba7-5b03b04c3023 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:19.020369 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-3dfc29bc-13a2-4249-9ba7-5b03b04c3023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:19.034750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc29bc-13a2-4249-9ba7-5b03b04c3023 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:19.095153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:19.096113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:19.096364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:19.096680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] PATH_INFO: `/v3/users/9be25ceb16b54c58b64693a6c6f63855` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:19.097974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be25ceb16b54c58b64693a6c6f63855)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:19.100206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:19.155962 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be25ceb16b54c58b64693a6c6f63855'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:19.170233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be25ceb16b54c58b64693a6c6f63855'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:19.180424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be25ceb16b54c58b64693a6c6f63855'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:19.189052 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be25ceb16b54c58b64693a6c6f63855'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:19.190310 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be25ceb16b54c58b64693a6c6f63855'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:19.196903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1184/2370] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:50:19 2021] DELETE /identity/v3/users/9be25ceb16b54c58b64693a6c6f63855 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:19.201609 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ac759-67e7-435f-bbe6-283548425df2 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:19.202234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ac759-67e7-435f-bbe6-283548425df2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:19.202331 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ac759-67e7-435f-bbe6-283548425df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:19.222460 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-868ac759-67e7-435f-bbe6-283548425df2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:19.223712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-868ac759-67e7-435f-bbe6-283548425df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:19.290430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1187/2371] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:19.302578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:19.304087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:19.366148 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b97ca6-01ec-448d-afcf-efb89d1f8daa admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:19.370634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80408ef1-b351-4fa0-b47e-cb1315880f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:19.371265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80408ef1-b351-4fa0-b47e-cb1315880f28 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:19.371543 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80408ef1-b351-4fa0-b47e-cb1315880f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:19.371812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80408ef1-b351-4fa0-b47e-cb1315880f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:19.384038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80408ef1-b351-4fa0-b47e-cb1315880f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:19.385539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80408ef1-b351-4fa0-b47e-cb1315880f28 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:19.396419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1185/2372] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:19.712142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ac759-67e7-435f-bbe6-283548425df2 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:19.714398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-868ac759-67e7-435f-bbe6-283548425df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:19.731679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ac759-67e7-435f-bbe6-283548425df2 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:19.738316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:19.740254 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:19.740897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:19.741329 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] PATH_INFO: `/v3/projects/1f403b1039c14150a1b4eac4f87b3734` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:19.746014 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f403b1039c14150a1b4eac4f87b3734)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:19.749577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:19.811341 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f403b1039c14150a1b4eac4f87b3734', 'request_id': 'req-49eafeab-1725-46a4-95bc-6bcaa5f4439e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:19.821599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f403b1039c14150a1b4eac4f87b3734', 'request_id': 'req-49eafeab-1725-46a4-95bc-6bcaa5f4439e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:19.828905 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f403b1039c14150a1b4eac4f87b3734', 'request_id': 'req-49eafeab-1725-46a4-95bc-6bcaa5f4439e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:19.840092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] The token cache is being invalidate because project 1f403b1039c14150a1b4eac4f87b3734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:50:19.840383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:19.841113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-49eafeab-1725-46a4-95bc-6bcaa5f4439e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:19.842717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1188/2373] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:50:19 2021] DELETE /identity/v3/projects/1f403b1039c14150a1b4eac4f87b3734 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:19.849439 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cd4ae-ea06-4943-aa0a-9caba8e27117 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:19.849722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cd4ae-ea06-4943-aa0a-9caba8e27117 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:19.850064 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495cd4ae-ea06-4943-aa0a-9caba8e27117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:19.869859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-495cd4ae-ea06-4943-aa0a-9caba8e27117 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:19.871059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-495cd4ae-ea06-4943-aa0a-9caba8e27117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:19.934571 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1186/2374] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:19.943427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61ec51-4cfc-42ba-bf39-c1d258bff6d2 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:19.943687 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61ec51-4cfc-42ba-bf39-c1d258bff6d2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:19.943974 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61ec51-4cfc-42ba-bf39-c1d258bff6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:19.965542 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-ad61ec51-4cfc-42ba-bf39-c1d258bff6d2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:19.966857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ad61ec51-4cfc-42ba-bf39-c1d258bff6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:19.977334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1189/2375] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:19 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:19.981986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cd4ae-ea06-4943-aa0a-9caba8e27117 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:19.993060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495cd4ae-ea06-4943-aa0a-9caba8e27117 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:19.999550 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803941ef-1f56-4ec1-afd5-ed2ac967eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:20.000246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803941ef-1f56-4ec1-afd5-ed2ac967eae0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:20.000478 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803941ef-1f56-4ec1-afd5-ed2ac967eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:20.000815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803941ef-1f56-4ec1-afd5-ed2ac967eae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:20.001575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803941ef-1f56-4ec1-afd5-ed2ac967eae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:50:20.001883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803941ef-1f56-4ec1-afd5-ed2ac967eae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:20.003609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803941ef-1f56-4ec1-afd5-ed2ac967eae0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:20.018403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1187/2376] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:50:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:50:20.022949 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61ec51-4cfc-42ba-bf39-c1d258bff6d2 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:20.034241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61ec51-4cfc-42ba-bf39-c1d258bff6d2 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:20.040172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91005fa0-d0b5-4fb9-a8fd-7dd37cf3373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:20.040907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91005fa0-d0b5-4fb9-a8fd-7dd37cf3373e admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:20.041188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91005fa0-d0b5-4fb9-a8fd-7dd37cf3373e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:20.041462 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91005fa0-d0b5-4fb9-a8fd-7dd37cf3373e admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:20.042184 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91005fa0-d0b5-4fb9-a8fd-7dd37cf3373e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:20.044150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91005fa0-d0b5-4fb9-a8fd-7dd37cf3373e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:20.076828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1190/2377] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:50:20 2021] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:50:20.081780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803941ef-1f56-4ec1-afd5-ed2ac967eae0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:20.093122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803941ef-1f56-4ec1-afd5-ed2ac967eae0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:20.151788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad60e4-e92f-4dcb-bcb7-e57994cb1975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:20.152471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad60e4-e92f-4dcb-bcb7-e57994cb1975 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:20.152785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad60e4-e92f-4dcb-bcb7-e57994cb1975 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:20.153082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad60e4-e92f-4dcb-bcb7-e57994cb1975 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:20.153777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad60e4-e92f-4dcb-bcb7-e57994cb1975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:20.155737 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad60e4-e92f-4dcb-bcb7-e57994cb1975 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:20.175496 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1188/2378] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:50:20 2021] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:50:20.179981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91005fa0-d0b5-4fb9-a8fd-7dd37cf3373e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:20.191266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91005fa0-d0b5-4fb9-a8fd-7dd37cf3373e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:20.197553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8976a69-45d1-4f2d-9db1-c3733112a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:20.198287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8976a69-45d1-4f2d-9db1-c3733112a341 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:20.198927 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8976a69-45d1-4f2d-9db1-c3733112a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:20.198927 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8976a69-45d1-4f2d-9db1-c3733112a341 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:20.199676 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8976a69-45d1-4f2d-9db1-c3733112a341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:20.201321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8976a69-45d1-4f2d-9db1-c3733112a341 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:20.213347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1191/2379] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:50:20 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:50:20.218453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad60e4-e92f-4dcb-bcb7-e57994cb1975 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:20.229906 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad60e4-e92f-4dcb-bcb7-e57994cb1975 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:20.235982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1f42d-129d-4ba7-8217-83c897fe1497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:20.236876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1f42d-129d-4ba7-8217-83c897fe1497 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:20.237161 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1f42d-129d-4ba7-8217-83c897fe1497 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:20.237430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1f42d-129d-4ba7-8217-83c897fe1497 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:20.238269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1f42d-129d-4ba7-8217-83c897fe1497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:20.239876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1f42d-129d-4ba7-8217-83c897fe1497 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:20.250730 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1189/2380] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:50:20 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:50:20.255647 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8976a69-45d1-4f2d-9db1-c3733112a341 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:20.265992 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8976a69-45d1-4f2d-9db1-c3733112a341 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:20.271506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df448510-ce8e-4b68-aa46-c9c19e510d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:20.272394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df448510-ce8e-4b68-aa46-c9c19e510d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:20.272716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df448510-ce8e-4b68-aa46-c9c19e510d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:20.272991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df448510-ce8e-4b68-aa46-c9c19e510d96 admin admin] PATH_INFO: `/v3/projects/573f4507ec8f41eb938c17dc3c07cb4e/users/6c3a05e2599149449be08cc2ed91082c/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:20.288899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df448510-ce8e-4b68-aa46-c9c19e510d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=573f4507ec8f41eb938c17dc3c07cb4e, user_id=6c3a05e2599149449be08cc2ed91082c, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:20.291542 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df448510-ce8e-4b68-aa46-c9c19e510d96 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:20.306268 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1192/2381] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:50:20 2021] PUT /identity/v3/projects/573f4507ec8f41eb938c17dc3c07cb4e/users/6c3a05e2599149449be08cc2ed91082c/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:20.318462 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4b7c3-454f-41a8-8f16-3c39f4311577 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:20.318747 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4b7c3-454f-41a8-8f16-3c39f4311577 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:20.319024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d4b7c3-454f-41a8-8f16-3c39f4311577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:20.349414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-95d4b7c3-454f-41a8-8f16-3c39f4311577 None None] MFA Rules not processed for user `6c3a05e2599149449be08cc2ed91082c`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:20.350566 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-95d4b7c3-454f-41a8-8f16-3c39f4311577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:20.417072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1190/2382] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:20 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:20.428191 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df448510-ce8e-4b68-aa46-c9c19e510d96 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:20.431024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-df448510-ce8e-4b68-aa46-c9c19e510d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:20.510657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df448510-ce8e-4b68-aa46-c9c19e510d96 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:20.516385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5c4c5-335d-4c35-941b-aeb07f665d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:20.517104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5c4c5-335d-4c35-941b-aeb07f665d22 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:20.517389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5c4c5-335d-4c35-941b-aeb07f665d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:20.517800 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5c4c5-335d-4c35-941b-aeb07f665d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:20.532642 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5c4c5-335d-4c35-941b-aeb07f665d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:20.534688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5c4c5-335d-4c35-941b-aeb07f665d22 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:20.545214 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1193/2383] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:20 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:21.941414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26fa1-5829-4477-8bde-8203a3692ee9 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:21.941414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26fa1-5829-4477-8bde-8203a3692ee9 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:21.942134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26fa1-5829-4477-8bde-8203a3692ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:21.963735 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-34a26fa1-5829-4477-8bde-8203a3692ee9 None None] MFA Rules not processed for user `6c3a05e2599149449be08cc2ed91082c`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:21.965099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-34a26fa1-5829-4477-8bde-8203a3692ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:21.974780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1191/2384] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:21 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:34.006554 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5c4c5-335d-4c35-941b-aeb07f665d22 service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:34.007123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4bc5c4c5-335d-4c35-941b-aeb07f665d22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:34.085860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5c4c5-335d-4c35-941b-aeb07f665d22 service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:34.091611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:34.092684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:34.093138 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:34.093513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] PATH_INFO: `/v3/users/f9e1ef65024342fd98733231d828d2c8` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:34.094968 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e1ef65024342fd98733231d828d2c8)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:34.098109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:34.158307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e1ef65024342fd98733231d828d2c8'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:34.173613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e1ef65024342fd98733231d828d2c8'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:34.174746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e1ef65024342fd98733231d828d2c8'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:34.184388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e1ef65024342fd98733231d828d2c8'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:34.197932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e1ef65024342fd98733231d828d2c8'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:34.204942 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1194/2385] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:50:34 2021] DELETE /identity/v3/users/f9e1ef65024342fd98733231d828d2c8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:34.209750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb131c3-df3c-4769-98c9-d2900a05e2fa None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:34.210333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb131c3-df3c-4769-98c9-d2900a05e2fa None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:34.210333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb131c3-df3c-4769-98c9-d2900a05e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:34.229793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-eeb131c3-df3c-4769-98c9-d2900a05e2fa None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:34.231016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-eeb131c3-df3c-4769-98c9-d2900a05e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:34.308415 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1192/2386] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:34.322075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:34.323891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:34.407805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c84ff-3c3d-48cd-972e-0295d7f6b195 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:34.412554 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01db68-0c48-4d6a-ab4e-a2eab91b325d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:34.413337 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01db68-0c48-4d6a-ab4e-a2eab91b325d service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:34.413626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01db68-0c48-4d6a-ab4e-a2eab91b325d service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:34.413893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01db68-0c48-4d6a-ab4e-a2eab91b325d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:34.424726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01db68-0c48-4d6a-ab4e-a2eab91b325d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:34.426281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01db68-0c48-4d6a-ab4e-a2eab91b325d service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:34.437920 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1195/2387] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:34 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:34.821522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb131c3-df3c-4769-98c9-d2900a05e2fa None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:34.823541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-eeb131c3-df3c-4769-98c9-d2900a05e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:34.837802 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb131c3-df3c-4769-98c9-d2900a05e2fa None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:34.843246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:34.844107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:34.844637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:34.844898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] PATH_INFO: `/v3/projects/37ee76160c814e90bffcc2b3c4c54446` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:34.847305 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ee76160c814e90bffcc2b3c4c54446)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:34.849604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:34.924392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ee76160c814e90bffcc2b3c4c54446', 'request_id': 'req-8392106c-63b4-475c-9213-2dd221c76528'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:34.936960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ee76160c814e90bffcc2b3c4c54446', 'request_id': 'req-8392106c-63b4-475c-9213-2dd221c76528'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:34.948179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ee76160c814e90bffcc2b3c4c54446', 'request_id': 'req-8392106c-63b4-475c-9213-2dd221c76528'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:34.960664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] The token cache is being invalidate because project 37ee76160c814e90bffcc2b3c4c54446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:50:34.961115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:34.962059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8392106c-63b4-475c-9213-2dd221c76528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:34.964211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1193/2388] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:50:34 2021] DELETE /identity/v3/projects/37ee76160c814e90bffcc2b3c4c54446 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:34.971045 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b4bff-1421-4138-a12e-884cc546826b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:34.971045 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b4bff-1421-4138-a12e-884cc546826b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:34.971045 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b4bff-1421-4138-a12e-884cc546826b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:34.992036 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-d80b4bff-1421-4138-a12e-884cc546826b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:34.993291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d80b4bff-1421-4138-a12e-884cc546826b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:35.079494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1196/2389] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:35.091241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fae69-b4ef-4e5b-b6c1-2ded8aa804f1 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:35.091550 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fae69-b4ef-4e5b-b6c1-2ded8aa804f1 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:35.091827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fae69-b4ef-4e5b-b6c1-2ded8aa804f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:35.113194 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c27fae69-b4ef-4e5b-b6c1-2ded8aa804f1 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:35.114436 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c27fae69-b4ef-4e5b-b6c1-2ded8aa804f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:35.125844 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1194/2390] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:35.131720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b4bff-1421-4138-a12e-884cc546826b None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:35.142748 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b4bff-1421-4138-a12e-884cc546826b None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:35.148330 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba30f-9a40-4930-9eef-d0372e802f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:35.149053 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba30f-9a40-4930-9eef-d0372e802f61 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:35.149316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba30f-9a40-4930-9eef-d0372e802f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:35.149644 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba30f-9a40-4930-9eef-d0372e802f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:35.150334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bba30f-9a40-4930-9eef-d0372e802f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:50:35.150629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bba30f-9a40-4930-9eef-d0372e802f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:35.152300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bba30f-9a40-4930-9eef-d0372e802f61 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:35.166846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1197/2391] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:50:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:50:35.172536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fae69-b4ef-4e5b-b6c1-2ded8aa804f1 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:35.184563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fae69-b4ef-4e5b-b6c1-2ded8aa804f1 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:35.189941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178d830-b49e-41dd-a601-1054d7e4076a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:35.190631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178d830-b49e-41dd-a601-1054d7e4076a admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:35.190907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178d830-b49e-41dd-a601-1054d7e4076a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:35.191174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178d830-b49e-41dd-a601-1054d7e4076a admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:35.191892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178d830-b49e-41dd-a601-1054d7e4076a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:35.193883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178d830-b49e-41dd-a601-1054d7e4076a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:35.227129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1195/2392] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:50:35 2021] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:50:35.231243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba30f-9a40-4930-9eef-d0372e802f61 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:35.242196 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba30f-9a40-4930-9eef-d0372e802f61 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:35.299809 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dced0-e4ed-45eb-925b-b553e048be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:35.300490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dced0-e4ed-45eb-925b-b553e048be41 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:35.301105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dced0-e4ed-45eb-925b-b553e048be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:35.301105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dced0-e4ed-45eb-925b-b553e048be41 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:35.301896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dced0-e4ed-45eb-925b-b553e048be41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:35.303895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dced0-e4ed-45eb-925b-b553e048be41 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:35.335017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1198/2393] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:50:35 2021] POST /identity/v3/users => generated 291 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:50:35.336079 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178d830-b49e-41dd-a601-1054d7e4076a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:35.347277 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178d830-b49e-41dd-a601-1054d7e4076a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:35.352046 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fd9b6-45f0-4781-a3d7-34b1f46c9f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:35.352750 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd9b6-45f0-4781-a3d7-34b1f46c9f37 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:35.353030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd9b6-45f0-4781-a3d7-34b1f46c9f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:35.353300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fd9b6-45f0-4781-a3d7-34b1f46c9f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:35.354154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fd9b6-45f0-4781-a3d7-34b1f46c9f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:35.355755 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fd9b6-45f0-4781-a3d7-34b1f46c9f37 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:35.367476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1196/2394] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:50:35 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:50:35.372025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dced0-e4ed-45eb-925b-b553e048be41 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:35.382408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dced0-e4ed-45eb-925b-b553e048be41 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:35.386935 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1b041-2e2d-4c68-89a5-52d7e0a753d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:35.387605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b041-2e2d-4c68-89a5-52d7e0a753d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:35.387867 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b041-2e2d-4c68-89a5-52d7e0a753d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:35.388137 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b041-2e2d-4c68-89a5-52d7e0a753d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:35.388910 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1b041-2e2d-4c68-89a5-52d7e0a753d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:35.390506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1b041-2e2d-4c68-89a5-52d7e0a753d3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:35.400782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1199/2395] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:50:35 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:50:35.405002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fd9b6-45f0-4781-a3d7-34b1f46c9f37 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:35.415119 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fd9b6-45f0-4781-a3d7-34b1f46c9f37 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:35.420707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41935cfb-29f2-45d5-9c30-55bbdec59cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:35.421617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41935cfb-29f2-45d5-9c30-55bbdec59cdb admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:35.421894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41935cfb-29f2-45d5-9c30-55bbdec59cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:35.422241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41935cfb-29f2-45d5-9c30-55bbdec59cdb admin admin] PATH_INFO: `/v3/projects/a2582447f23e4d388146670235c51d91/users/5ef49d5682214edf8f95293d0041aa85/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:35.438832 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41935cfb-29f2-45d5-9c30-55bbdec59cdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2582447f23e4d388146670235c51d91, user_id=5ef49d5682214edf8f95293d0041aa85, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:35.441549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41935cfb-29f2-45d5-9c30-55bbdec59cdb admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:35.456810 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1197/2396] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:50:35 2021] PUT /identity/v3/projects/a2582447f23e4d388146670235c51d91/users/5ef49d5682214edf8f95293d0041aa85/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:35.462442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a337d-3e03-4020-810e-ca487e189cc6 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:35.462729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a337d-3e03-4020-810e-ca487e189cc6 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:35.463000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a337d-3e03-4020-810e-ca487e189cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:35.482138 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-844a337d-3e03-4020-810e-ca487e189cc6 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:35.483312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-844a337d-3e03-4020-810e-ca487e189cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:35.561732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1200/2397] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:35.571203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41935cfb-29f2-45d5-9c30-55bbdec59cdb admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:35.573191 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-41935cfb-29f2-45d5-9c30-55bbdec59cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:35.650212 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41935cfb-29f2-45d5-9c30-55bbdec59cdb admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:35.657047 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b614c-37ca-496c-a83c-568904fcc958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:35.657729 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b614c-37ca-496c-a83c-568904fcc958 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:35.658024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b614c-37ca-496c-a83c-568904fcc958 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:35.658952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b614c-37ca-496c-a83c-568904fcc958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:35.675141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b614c-37ca-496c-a83c-568904fcc958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:35.677432 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b614c-37ca-496c-a83c-568904fcc958 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:35.687446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1198/2398] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:50:36.636465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956efa7f-63a8-49ea-be4a-c44b0caf2e30 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:36.637553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956efa7f-63a8-49ea-be4a-c44b0caf2e30 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:36.637553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956efa7f-63a8-49ea-be4a-c44b0caf2e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:36.668979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-956efa7f-63a8-49ea-be4a-c44b0caf2e30 None None] MFA Rules not processed for user `5ef49d5682214edf8f95293d0041aa85`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:36.670304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-956efa7f-63a8-49ea-be4a-c44b0caf2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:36.749063 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1201/2399] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:36 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:36.762736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b614c-37ca-496c-a83c-568904fcc958 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:36.764883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-4f0b614c-37ca-496c-a83c-568904fcc958 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:36.827971 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b614c-37ca-496c-a83c-568904fcc958 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:36.833055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f5f7c-2f59-4685-b560-1f5a4b94c3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:36.833745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f5f7c-2f59-4685-b560-1f5a4b94c3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:36.834028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f5f7c-2f59-4685-b560-1f5a4b94c3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:36.834307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f5f7c-2f59-4685-b560-1f5a4b94c3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:36.843697 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f5f7c-2f59-4685-b560-1f5a4b94c3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:36.845200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f5f7c-2f59-4685-b560-1f5a4b94c3b3 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:36.855188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1199/2400] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:36 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:37.641450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf295058-bb3c-4557-b044-d5069e9c2925 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:37.643049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf295058-bb3c-4557-b044-d5069e9c2925 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:37.645365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf295058-bb3c-4557-b044-d5069e9c2925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:37.680340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-bf295058-bb3c-4557-b044-d5069e9c2925 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:37.682325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bf295058-bb3c-4557-b044-d5069e9c2925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:37.821136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1202/2401] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:50:37 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:37.889972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f5f7c-2f59-4685-b560-1f5a4b94c3b3 service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:37.892031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9b2f5f7c-2f59-4685-b560-1f5a4b94c3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:38.010186 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f5f7c-2f59-4685-b560-1f5a4b94c3b3 service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:38.016413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35132e28-fcf2-4d56-af91-50d59acb9a64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:38.016413 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35132e28-fcf2-4d56-af91-50d59acb9a64 service swift] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:38.017634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35132e28-fcf2-4d56-af91-50d59acb9a64 service swift] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:38.017634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35132e28-fcf2-4d56-af91-50d59acb9a64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:38.026382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35132e28-fcf2-4d56-af91-50d59acb9a64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:38.028321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35132e28-fcf2-4d56-af91-50d59acb9a64 service swift] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:38.037406 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1200/2402] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:50:37 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:50:38.262897 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4e5c3-15b7-4d38-bc4f-d82629d3c873 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:38.263438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4e5c3-15b7-4d38-bc4f-d82629d3c873 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:38.263902 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4e5c3-15b7-4d38-bc4f-d82629d3c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:38.286435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-eec4e5c3-15b7-4d38-bc4f-d82629d3c873 None None] MFA Rules not processed for user `5ef49d5682214edf8f95293d0041aa85`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:38.288413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-eec4e5c3-15b7-4d38-bc4f-d82629d3c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:38.308702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1203/2403] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:38 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:40.419178 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106450e9-8929-4a35-985c-9ce00b95d377 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:40.419989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106450e9-8929-4a35-985c-9ce00b95d377 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:40.420502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106450e9-8929-4a35-985c-9ce00b95d377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:40.449432 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-106450e9-8929-4a35-985c-9ce00b95d377 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:40.451835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-106450e9-8929-4a35-985c-9ce00b95d377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:40.461104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1201/2404] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:50:40 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:40.481836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4e5c3-15b7-4d38-bc4f-d82629d3c873 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:40.505818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4e5c3-15b7-4d38-bc4f-d82629d3c873 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:40.519059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ee196-3e51-47a5-9490-f9472a15856f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:40.520284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ee196-3e51-47a5-9490-f9472a15856f service swift] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:40.520831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ee196-3e51-47a5-9490-f9472a15856f service swift] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:40.521459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ee196-3e51-47a5-9490-f9472a15856f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:40.552056 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ee196-3e51-47a5-9490-f9472a15856f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:40.557419 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ee196-3e51-47a5-9490-f9472a15856f service swift] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:40.585533 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1204/2405] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:50:40 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:50:41.983514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e7a3b-1eb1-4432-941d-0fc339626ed3 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:41.984396 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e7a3b-1eb1-4432-941d-0fc339626ed3 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:41.984885 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e7a3b-1eb1-4432-941d-0fc339626ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:42.004867 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-081e7a3b-1eb1-4432-941d-0fc339626ed3 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:42.006199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-081e7a3b-1eb1-4432-941d-0fc339626ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:42.013749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1202/2406] 10.222.0.62 () {58 vars in 967 bytes} [Mon Dec 13 16:50:41 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:42.028953 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ee196-3e51-47a5-9490-f9472a15856f service swift] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:42.042817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ee196-3e51-47a5-9490-f9472a15856f service swift] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:42.049024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cb91c-1a84-4029-b5ee-a72c5cad3b09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:42.050256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cb91c-1a84-4029-b5ee-a72c5cad3b09 service swift] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:42.050852 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cb91c-1a84-4029-b5ee-a72c5cad3b09 service swift] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:42.051281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cb91c-1a84-4029-b5ee-a72c5cad3b09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:42.067713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cb91c-1a84-4029-b5ee-a72c5cad3b09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:42.069967 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cb91c-1a84-4029-b5ee-a72c5cad3b09 service swift] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:42.083175 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1205/2407] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:50:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:50:42.570356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed562440-bb0f-45f5-a2a6-7bbd3ea12760 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:42.570664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed562440-bb0f-45f5-a2a6-7bbd3ea12760 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:42.571759 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed562440-bb0f-45f5-a2a6-7bbd3ea12760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:42.594827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-ed562440-bb0f-45f5-a2a6-7bbd3ea12760 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:42.601625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ed562440-bb0f-45f5-a2a6-7bbd3ea12760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:42.612387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1203/2408] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:50:42 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:42.628229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cb91c-1a84-4029-b5ee-a72c5cad3b09 service swift] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:42.641286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cb91c-1a84-4029-b5ee-a72c5cad3b09 service swift] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:42.646781 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e4a30-bf4e-4379-9c9f-43b717ae9e26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:42.647423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e4a30-bf4e-4379-9c9f-43b717ae9e26 service swift] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:42.647879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e4a30-bf4e-4379-9c9f-43b717ae9e26 service swift] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:42.648307 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e4a30-bf4e-4379-9c9f-43b717ae9e26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:42.657284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e4a30-bf4e-4379-9c9f-43b717ae9e26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:42.659341 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597e4a30-bf4e-4379-9c9f-43b717ae9e26 service swift] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:42.668365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1206/2409] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:50:42 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:50:43.312918 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2b7c-54ff-4f75-97b7-fb648e927ab8 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:43.313517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2b7c-54ff-4f75-97b7-fb648e927ab8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:43.313656 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc2b7c-54ff-4f75-97b7-fb648e927ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:43.364524 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c7dc2b7c-54ff-4f75-97b7-fb648e927ab8 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:43.373735 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c7dc2b7c-54ff-4f75-97b7-fb648e927ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:43.402944 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1204/2410] 10.222.0.62 () {58 vars in 967 bytes} [Mon Dec 13 16:50:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:50:43.434173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e4a30-bf4e-4379-9c9f-43b717ae9e26 service swift] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:43.448255 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e4a30-bf4e-4379-9c9f-43b717ae9e26 service swift] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:43.464082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8792f9-d8ad-4240-987c-0dddb30eb3a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:43.464772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8792f9-d8ad-4240-987c-0dddb30eb3a7 service swift] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:43.465247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8792f9-d8ad-4240-987c-0dddb30eb3a7 service swift] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:43.465690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8792f9-d8ad-4240-987c-0dddb30eb3a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:43.479083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8792f9-d8ad-4240-987c-0dddb30eb3a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:43.481247 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8792f9-d8ad-4240-987c-0dddb30eb3a7 service swift] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:43.501063 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1207/2411] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:50:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:50:46.244438 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2b7c-54ff-4f75-97b7-fb648e927ab8 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:46.246690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c7dc2b7c-54ff-4f75-97b7-fb648e927ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:46.262232 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc2b7c-54ff-4f75-97b7-fb648e927ab8 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:46.267125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:46.268055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:46.268345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:46.268845 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] PATH_INFO: `/v3/users/6c3a05e2599149449be08cc2ed91082c` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:46.281642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c3a05e2599149449be08cc2ed91082c)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:46.284691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:46.370872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c3a05e2599149449be08cc2ed91082c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:46.397356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c3a05e2599149449be08cc2ed91082c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:46.481447 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c3a05e2599149449be08cc2ed91082c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:46.491226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c3a05e2599149449be08cc2ed91082c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:46.492193 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c3a05e2599149449be08cc2ed91082c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:46.499387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1205/2412] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:50:46 2021] DELETE /identity/v3/users/6c3a05e2599149449be08cc2ed91082c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:46.504764 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4470bc-3a90-4d3f-bb77-9dbb2f87c2ac None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:46.505280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4470bc-3a90-4d3f-bb77-9dbb2f87c2ac None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:46.505393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4470bc-3a90-4d3f-bb77-9dbb2f87c2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:46.525633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-ee4470bc-3a90-4d3f-bb77-9dbb2f87c2ac None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:46.526846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ee4470bc-3a90-4d3f-bb77-9dbb2f87c2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:46.605445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1208/2413] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:50:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:46.617306 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:46.619078 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:46.685433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d248404-9eb0-43e1-a4e9-22360a779f28 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:46.691871 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045e193-45f6-4fe3-a319-d0a063f56e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:46.692184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045e193-45f6-4fe3-a319-d0a063f56e06 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:46.692604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045e193-45f6-4fe3-a319-d0a063f56e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:46.693176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045e193-45f6-4fe3-a319-d0a063f56e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:46.704664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045e193-45f6-4fe3-a319-d0a063f56e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:46.709082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045e193-45f6-4fe3-a319-d0a063f56e06 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:46.725552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1206/2414] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:46.975072 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4470bc-3a90-4d3f-bb77-9dbb2f87c2ac None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:46.976553 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ee4470bc-3a90-4d3f-bb77-9dbb2f87c2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:46.999885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4470bc-3a90-4d3f-bb77-9dbb2f87c2ac None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:47.004122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:47.005207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:47.005968 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:47.005968 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] PATH_INFO: `/v3/projects/573f4507ec8f41eb938c17dc3c07cb4e` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:47.007256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=573f4507ec8f41eb938c17dc3c07cb4e)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:47.009475 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:47.099142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '573f4507ec8f41eb938c17dc3c07cb4e', 'request_id': 'req-4c073695-d91b-4a9a-9e76-054d79fad183'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:47.121549 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '573f4507ec8f41eb938c17dc3c07cb4e', 'request_id': 'req-4c073695-d91b-4a9a-9e76-054d79fad183'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:47.131196 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '573f4507ec8f41eb938c17dc3c07cb4e', 'request_id': 'req-4c073695-d91b-4a9a-9e76-054d79fad183'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:47.148829 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] The token cache is being invalidate because project 573f4507ec8f41eb938c17dc3c07cb4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:50:47.149123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:47.149944 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-4c073695-d91b-4a9a-9e76-054d79fad183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:50:47.151527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1209/2415] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:50:46 2021] DELETE /identity/v3/projects/573f4507ec8f41eb938c17dc3c07cb4e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:50:54.982352 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405cb33-9749-4f60-98b3-bf1607470051 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:54.983011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405cb33-9749-4f60-98b3-bf1607470051 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:54.983408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405cb33-9749-4f60-98b3-bf1607470051 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:54.985731 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1207/2416] 10.222.0.62 () {54 vars in 921 bytes} [Mon Dec 13 16:50:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:50:54.995092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d29d74-02fd-400e-b532-5b5f5c5981d5 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:54.996151 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d29d74-02fd-400e-b532-5b5f5c5981d5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:55.000804 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d29d74-02fd-400e-b532-5b5f5c5981d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:55.036555 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-99d29d74-02fd-400e-b532-5b5f5c5981d5 None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:55.037969 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-99d29d74-02fd-400e-b532-5b5f5c5981d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:55.191401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1210/2417] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Dec 13 16:50:54 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:55.204892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405cb33-9749-4f60-98b3-bf1607470051 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:55.206613 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1405cb33-9749-4f60-98b3-bf1607470051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:55.280080 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405cb33-9749-4f60-98b3-bf1607470051 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:55.284387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf021b-ab6f-4576-9a6a-f831e3a41424 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18f1422ce48e44ab85e6d5e10d1ea898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:55.285079 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf021b-ab6f-4576-9a6a-f831e3a41424 service glance] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:55.285361 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf021b-ab6f-4576-9a6a-f831e3a41424 service glance] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:55.285634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf021b-ab6f-4576-9a6a-f831e3a41424 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:55.296427 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf021b-ab6f-4576-9a6a-f831e3a41424 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:55.297965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf021b-ab6f-4576-9a6a-f831e3a41424 service glance] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:55.309283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1208/2418] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:55.387462 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c2ae3-aff1-4f90-9547-e85eed76689d None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:55.387743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c2ae3-aff1-4f90-9547-e85eed76689d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:55.388024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c2ae3-aff1-4f90-9547-e85eed76689d None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:55.389893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1211/2419] 10.222.0.62 () {54 vars in 921 bytes} [Mon Dec 13 16:50:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:50:55.395069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15141a-3914-4a1d-b6e7-b8cbeeb06124 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:55.395356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15141a-3914-4a1d-b6e7-b8cbeeb06124 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:55.395629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15141a-3914-4a1d-b6e7-b8cbeeb06124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:55.428764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-8b15141a-3914-4a1d-b6e7-b8cbeeb06124 None None] MFA Rules not processed for user `51f9a10e3d87475e92fb49686f1aa456`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:55.429985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8b15141a-3914-4a1d-b6e7-b8cbeeb06124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:55.494914 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1209/2420] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Dec 13 16:50:55 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:55.507370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c2ae3-aff1-4f90-9547-e85eed76689d None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:55.509366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d30c2ae3-aff1-4f90-9547-e85eed76689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:55.523866 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c2ae3-aff1-4f90-9547-e85eed76689d None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:55.528371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35340c45-b007-4b5e-a509-478d3f4a04ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:55.529060 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340c45-b007-4b5e-a509-478d3f4a04ff service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:55.529342 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340c45-b007-4b5e-a509-478d3f4a04ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:55.529612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35340c45-b007-4b5e-a509-478d3f4a04ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:55.537512 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35340c45-b007-4b5e-a509-478d3f4a04ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:55.538949 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35340c45-b007-4b5e-a509-478d3f4a04ff service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:55.546846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1212/2421] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:50:55 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:50:58.306600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770abdb-68fc-403b-a9ea-fd6e6bcb0b16 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:58.307134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770abdb-68fc-403b-a9ea-fd6e6bcb0b16 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:58.307134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770abdb-68fc-403b-a9ea-fd6e6bcb0b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:58.327990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-5770abdb-68fc-403b-a9ea-fd6e6bcb0b16 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:50:58.329607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-5770abdb-68fc-403b-a9ea-fd6e6bcb0b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:58.399194 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1210/2422] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:50:58 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:50:58.413326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35340c45-b007-4b5e-a509-478d3f4a04ff service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:50:58.414793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-35340c45-b007-4b5e-a509-478d3f4a04ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:50:58.493919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35340c45-b007-4b5e-a509-478d3f4a04ff service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:50:58.499754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75be6a-b562-4dab-84d7-3952ca6030f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:50:58.500347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75be6a-b562-4dab-84d7-3952ca6030f9 service swift] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:50:58.500659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75be6a-b562-4dab-84d7-3952ca6030f9 service swift] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:50:58.500936 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75be6a-b562-4dab-84d7-3952ca6030f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:50:58.510752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75be6a-b562-4dab-84d7-3952ca6030f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:50:58.512355 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75be6a-b562-4dab-84d7-3952ca6030f9 service swift] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:50:58.520951 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1213/2423] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:50:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 13 16:51:32.927020 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47270a6-612e-4ee6-86f7-e75edc5a9d4e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:51:32.927608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47270a6-612e-4ee6-86f7-e75edc5a9d4e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:51:32.927924 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47270a6-612e-4ee6-86f7-e75edc5a9d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:51:32.957015 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-b47270a6-612e-4ee6-86f7-e75edc5a9d4e None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:51:32.958226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b47270a6-612e-4ee6-86f7-e75edc5a9d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:51:32.972845 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1211/2424] 10.222.0.62 () {58 vars in 967 bytes} [Mon Dec 13 16:51:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:51:32.990264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75be6a-b562-4dab-84d7-3952ca6030f9 service swift] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:51:33.001640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75be6a-b562-4dab-84d7-3952ca6030f9 service swift] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:51:33.007683 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1aff9-2300-4a31-a925-e4f24d470130 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:51:33.008332 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1aff9-2300-4a31-a925-e4f24d470130 service swift] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:51:33.008635 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1aff9-2300-4a31-a925-e4f24d470130 service swift] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:51:33.008909 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1aff9-2300-4a31-a925-e4f24d470130 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:51:33.017952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1aff9-2300-4a31-a925-e4f24d470130 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:51:33.019563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1aff9-2300-4a31-a925-e4f24d470130 service swift] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:51:33.029004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1214/2425] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:51:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:51:40.716856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47270a6-612e-4ee6-86f7-e75edc5a9d4e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:51:40.718347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b47270a6-612e-4ee6-86f7-e75edc5a9d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:51:40.824252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47270a6-612e-4ee6-86f7-e75edc5a9d4e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:51:40.830262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b66a-5ed2-4125-a992-384f6890fad9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b7187c26dd41bea9f3c2b49de8ef28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:51:40.830929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b66a-5ed2-4125-a992-384f6890fad9 service placement] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:51:40.831216 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b66a-5ed2-4125-a992-384f6890fad9 service placement] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:51:40.831485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b66a-5ed2-4125-a992-384f6890fad9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:51:40.833389 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6b38b66a-5ed2-4125-a992-384f6890fad9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:51:40.845960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38b66a-5ed2-4125-a992-384f6890fad9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:51:40.847388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38b66a-5ed2-4125-a992-384f6890fad9 service placement] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:51:40.857812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1212/2426] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:51:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:51:50.251078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50787b4-f9db-4fd3-9828-2dc80afb95ec None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:51:50.251624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50787b4-f9db-4fd3-9828-2dc80afb95ec None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:51:50.251624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50787b4-f9db-4fd3-9828-2dc80afb95ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:51:50.270590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a50787b4-f9db-4fd3-9828-2dc80afb95ec None None] MFA Rules not processed for user `5ef49d5682214edf8f95293d0041aa85`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:51:50.271825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a50787b4-f9db-4fd3-9828-2dc80afb95ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:51:50.329411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1215/2427] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:51:50 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:22.965773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b66a-5ed2-4125-a992-384f6890fad9 service placement] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:22.967362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-6b38b66a-5ed2-4125-a992-384f6890fad9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:23.077378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b66a-5ed2-4125-a992-384f6890fad9 service placement] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:23.082214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049a7ff-5320-4b93-be01-61f8e78c7e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:23.083092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049a7ff-5320-4b93-be01-61f8e78c7e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:23.083370 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049a7ff-5320-4b93-be01-61f8e78c7e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:23.083674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049a7ff-5320-4b93-be01-61f8e78c7e11 admin admin] PATH_INFO: `/v3/users/17b84b9ba4894db6985fcf9da882f56c` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:23.084936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049a7ff-5320-4b93-be01-61f8e78c7e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b84b9ba4894db6985fcf9da882f56c)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:23.086855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049a7ff-5320-4b93-be01-61f8e78c7e11 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:23.151576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2049a7ff-5320-4b93-be01-61f8e78c7e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b84b9ba4894db6985fcf9da882f56c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:23.165397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2049a7ff-5320-4b93-be01-61f8e78c7e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b84b9ba4894db6985fcf9da882f56c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:23.175040 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2049a7ff-5320-4b93-be01-61f8e78c7e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b84b9ba4894db6985fcf9da882f56c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:23.183934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2049a7ff-5320-4b93-be01-61f8e78c7e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b84b9ba4894db6985fcf9da882f56c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:23.185554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2049a7ff-5320-4b93-be01-61f8e78c7e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b84b9ba4894db6985fcf9da882f56c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:23.194714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1213/2428] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:52:22 2021] DELETE /identity/v3/users/17b84b9ba4894db6985fcf9da882f56c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:23.386241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50787b4-f9db-4fd3-9828-2dc80afb95ec None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:23.397860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50787b4-f9db-4fd3-9828-2dc80afb95ec None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:23.467977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:23.468911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:23.469191 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:23.469460 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] PATH_INFO: `/v3/projects/ab0bde5e0af14db49800fbdb92510291` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:23.471124 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0bde5e0af14db49800fbdb92510291)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:23.474706 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:23.523684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0bde5e0af14db49800fbdb92510291', 'request_id': 'req-e63ed8cf-ba61-4a99-9592-b3540d416e9d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:23.534454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0bde5e0af14db49800fbdb92510291', 'request_id': 'req-e63ed8cf-ba61-4a99-9592-b3540d416e9d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:23.541464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0bde5e0af14db49800fbdb92510291', 'request_id': 'req-e63ed8cf-ba61-4a99-9592-b3540d416e9d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:23.552400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] The token cache is being invalidate because project ab0bde5e0af14db49800fbdb92510291 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:52:23.552917 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:23.553572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-e63ed8cf-ba61-4a99-9592-b3540d416e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:23.555166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1216/2429] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:52:23 2021] DELETE /identity/v3/projects/ab0bde5e0af14db49800fbdb92510291 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:23.561240 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29514f-1d2c-4f0d-9b47-076c93e4fd97 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:23.561675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29514f-1d2c-4f0d-9b47-076c93e4fd97 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:23.562042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29514f-1d2c-4f0d-9b47-076c93e4fd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:23.626818 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-fa29514f-1d2c-4f0d-9b47-076c93e4fd97 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:23.628266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fa29514f-1d2c-4f0d-9b47-076c93e4fd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:23.692600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1214/2430] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:23.700965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ffcf1-4862-44da-b768-08789ac513cc None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:23.701546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ffcf1-4862-44da-b768-08789ac513cc None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:23.701827 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ffcf1-4862-44da-b768-08789ac513cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:23.723529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a97ffcf1-4862-44da-b768-08789ac513cc None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:23.724780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a97ffcf1-4862-44da-b768-08789ac513cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:23.733563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1217/2431] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:23.738074 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29514f-1d2c-4f0d-9b47-076c93e4fd97 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:23.748961 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29514f-1d2c-4f0d-9b47-076c93e4fd97 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:23.754654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9d46-16a1-4ca1-b49a-167a4e9bad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:23.755363 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9d46-16a1-4ca1-b49a-167a4e9bad6f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:23.755644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9d46-16a1-4ca1-b49a-167a4e9bad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:23.755917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f9d46-16a1-4ca1-b49a-167a4e9bad6f admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:23.756727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f9d46-16a1-4ca1-b49a-167a4e9bad6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:52:23.757036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f9d46-16a1-4ca1-b49a-167a4e9bad6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:23.758671 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f9d46-16a1-4ca1-b49a-167a4e9bad6f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:23.773158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1215/2432] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:52:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:52:23.777820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ffcf1-4862-44da-b768-08789ac513cc None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:23.788013 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ffcf1-4862-44da-b768-08789ac513cc None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:23.793947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1f960-c04d-4d70-8ad2-b32cdab9fc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:23.794609 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f960-c04d-4d70-8ad2-b32cdab9fc59 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:23.794891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f960-c04d-4d70-8ad2-b32cdab9fc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:23.795157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1f960-c04d-4d70-8ad2-b32cdab9fc59 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:23.795854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1f960-c04d-4d70-8ad2-b32cdab9fc59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:23.797817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1f960-c04d-4d70-8ad2-b32cdab9fc59 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:23.828019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1218/2433] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:52:23 2021] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:52:23.832642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9d46-16a1-4ca1-b49a-167a4e9bad6f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:23.842984 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f9d46-16a1-4ca1-b49a-167a4e9bad6f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:23.902319 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71ff2f-d7ed-439f-abb7-bc4366792352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:23.903008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ff2f-d7ed-439f-abb7-bc4366792352 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:23.903251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ff2f-d7ed-439f-abb7-bc4366792352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:23.903555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71ff2f-d7ed-439f-abb7-bc4366792352 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:23.904420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71ff2f-d7ed-439f-abb7-bc4366792352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:23.906367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71ff2f-d7ed-439f-abb7-bc4366792352 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:23.929833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1216/2434] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:52:23 2021] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:52:23.934281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1f960-c04d-4d70-8ad2-b32cdab9fc59 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:23.945358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1f960-c04d-4d70-8ad2-b32cdab9fc59 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:23.950188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726fc6e-bfbb-4494-81db-c537a92c0afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:23.950871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726fc6e-bfbb-4494-81db-c537a92c0afb admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:23.951154 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726fc6e-bfbb-4494-81db-c537a92c0afb admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:23.951428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726fc6e-bfbb-4494-81db-c537a92c0afb admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:23.952172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726fc6e-bfbb-4494-81db-c537a92c0afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:23.953845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726fc6e-bfbb-4494-81db-c537a92c0afb admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:23.968373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1219/2435] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:52:23.969996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71ff2f-d7ed-439f-abb7-bc4366792352 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:23.982500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71ff2f-d7ed-439f-abb7-bc4366792352 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:23.987985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adf554-dde4-4504-93f4-6b263dad4c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:23.988763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adf554-dde4-4504-93f4-6b263dad4c6b admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:23.989043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adf554-dde4-4504-93f4-6b263dad4c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:23.989315 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adf554-dde4-4504-93f4-6b263dad4c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:23.990405 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adf554-dde4-4504-93f4-6b263dad4c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:23.992029 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adf554-dde4-4504-93f4-6b263dad4c6b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:24.004355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1217/2436] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:23 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:52:24.008828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726fc6e-bfbb-4494-81db-c537a92c0afb admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:24.020839 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726fc6e-bfbb-4494-81db-c537a92c0afb admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:24.026491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02d8bc-21af-4d78-9ba0-2265bac4cc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:24.027736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02d8bc-21af-4d78-9ba0-2265bac4cc8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:24.028070 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02d8bc-21af-4d78-9ba0-2265bac4cc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:24.028381 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02d8bc-21af-4d78-9ba0-2265bac4cc8c admin admin] PATH_INFO: `/v3/projects/b9306145b4ac4f688cad6d5c56495f44/users/1e8a39bbc4c04c76a19241c17476215c/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:24.049720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02d8bc-21af-4d78-9ba0-2265bac4cc8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9306145b4ac4f688cad6d5c56495f44, user_id=1e8a39bbc4c04c76a19241c17476215c, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:24.052828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02d8bc-21af-4d78-9ba0-2265bac4cc8c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:24.072881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1220/2437] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:52:24 2021] PUT /identity/v3/projects/b9306145b4ac4f688cad6d5c56495f44/users/1e8a39bbc4c04c76a19241c17476215c/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:24.083646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca22b13-d6a0-4126-8b11-f662e0f7b852 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:24.083934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca22b13-d6a0-4126-8b11-f662e0f7b852 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:24.084208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca22b13-d6a0-4126-8b11-f662e0f7b852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:24.113708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-aca22b13-d6a0-4126-8b11-f662e0f7b852 None None] MFA Rules not processed for user `1e8a39bbc4c04c76a19241c17476215c`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:24.115267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-aca22b13-d6a0-4126-8b11-f662e0f7b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:24.182313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1218/2438] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:24 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:24.194117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02d8bc-21af-4d78-9ba0-2265bac4cc8c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:24.196117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cc02d8bc-21af-4d78-9ba0-2265bac4cc8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:24.308152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02d8bc-21af-4d78-9ba0-2265bac4cc8c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:24.314407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35354d-d232-4f1a-969d-43db870b91ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:24.315161 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35354d-d232-4f1a-969d-43db870b91ab service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:24.315677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35354d-d232-4f1a-969d-43db870b91ab service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:24.316047 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35354d-d232-4f1a-969d-43db870b91ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:24.331154 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35354d-d232-4f1a-969d-43db870b91ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:24.333033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35354d-d232-4f1a-969d-43db870b91ab service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:24.343804 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1221/2439] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:52:24 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:52:31.689609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca22b13-d6a0-4126-8b11-f662e0f7b852 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:31.759680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca22b13-d6a0-4126-8b11-f662e0f7b852 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:31.765714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:31.766761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:31.767144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:31.767436 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] PATH_INFO: `/v3/users/1e8a39bbc4c04c76a19241c17476215c` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:31.768779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8a39bbc4c04c76a19241c17476215c)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:31.770821 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:31.857466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8a39bbc4c04c76a19241c17476215c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:31.875859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8a39bbc4c04c76a19241c17476215c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:31.887785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8a39bbc4c04c76a19241c17476215c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:31.899617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8a39bbc4c04c76a19241c17476215c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:31.900380 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8a39bbc4c04c76a19241c17476215c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:31.909051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1219/2440] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:52:31 2021] DELETE /identity/v3/users/1e8a39bbc4c04c76a19241c17476215c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:31.914321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f962-4abd-4013-ad5d-7d7f6bf99b58 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:31.915151 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f962-4abd-4013-ad5d-7d7f6bf99b58 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:31.915578 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f962-4abd-4013-ad5d-7d7f6bf99b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:31.936895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a8c7f962-4abd-4013-ad5d-7d7f6bf99b58 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:31.938517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a8c7f962-4abd-4013-ad5d-7d7f6bf99b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:32.010808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1222/2441] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:32.021045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:32.022493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:32.097115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454ddab-fbcd-4152-96c2-5cfe6e9a6fdb admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:32.100912 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03b619-82c0-43a4-8b77-548da84a16b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:32.101582 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03b619-82c0-43a4-8b77-548da84a16b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:32.101860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03b619-82c0-43a4-8b77-548da84a16b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:32.102139 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03b619-82c0-43a4-8b77-548da84a16b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:32.119187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03b619-82c0-43a4-8b77-548da84a16b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:32.121484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03b619-82c0-43a4-8b77-548da84a16b8 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:32.135059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1220/2442] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:52:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:52:32.504970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7f962-4abd-4013-ad5d-7d7f6bf99b58 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:32.507213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a8c7f962-4abd-4013-ad5d-7d7f6bf99b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:32.559424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7f962-4abd-4013-ad5d-7d7f6bf99b58 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:32.567231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:32.568409 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:32.568756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:32.569524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] PATH_INFO: `/v3/projects/b9306145b4ac4f688cad6d5c56495f44` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:32.570636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9306145b4ac4f688cad6d5c56495f44)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:32.572903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:32.636763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9306145b4ac4f688cad6d5c56495f44', 'request_id': 'req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:32.649558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9306145b4ac4f688cad6d5c56495f44', 'request_id': 'req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:32.658519 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9306145b4ac4f688cad6d5c56495f44', 'request_id': 'req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:32.671268 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] The token cache is being invalidate because project b9306145b4ac4f688cad6d5c56495f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:52:32.671523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:32.672708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ad796bbd-b219-48f4-b04f-62b6f14dcc7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:32.677879 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1223/2443] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:52:32 2021] DELETE /identity/v3/projects/b9306145b4ac4f688cad6d5c56495f44 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:52:32.683116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a60f0-9884-4530-a12a-a68d71678b35 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:32.683558 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a60f0-9884-4530-a12a-a68d71678b35 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:32.683877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a60f0-9884-4530-a12a-a68d71678b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:32.703028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c36a60f0-9884-4530-a12a-a68d71678b35 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:32.704416 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c36a60f0-9884-4530-a12a-a68d71678b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:32.781432 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1221/2444] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:32.791043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a1cf1-5cdc-4426-83bc-27b5d28f509a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:32.791330 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a1cf1-5cdc-4426-83bc-27b5d28f509a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:32.791603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a1cf1-5cdc-4426-83bc-27b5d28f509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:32.811147 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9d0a1cf1-5cdc-4426-83bc-27b5d28f509a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:32.812348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9d0a1cf1-5cdc-4426-83bc-27b5d28f509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:32.821705 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1224/2445] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:32.826109 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a60f0-9884-4530-a12a-a68d71678b35 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:32.836554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a60f0-9884-4530-a12a-a68d71678b35 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:32.841882 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1a5b1-c681-4d91-8fcf-b2d27334f87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:32.842223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1a5b1-c681-4d91-8fcf-b2d27334f87f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:32.842502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1a5b1-c681-4d91-8fcf-b2d27334f87f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:32.842771 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1a5b1-c681-4d91-8fcf-b2d27334f87f admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:32.843572 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1a5b1-c681-4d91-8fcf-b2d27334f87f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:52:32.843812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1a5b1-c681-4d91-8fcf-b2d27334f87f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:32.845447 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1a5b1-c681-4d91-8fcf-b2d27334f87f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:32.857685 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1222/2446] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:52:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:52:32.862206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a1cf1-5cdc-4426-83bc-27b5d28f509a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:32.872105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a1cf1-5cdc-4426-83bc-27b5d28f509a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:32.876675 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cc25e-6300-443f-a41b-5041f95cb145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:32.877391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cc25e-6300-443f-a41b-5041f95cb145 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:32.877672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cc25e-6300-443f-a41b-5041f95cb145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:32.877943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cc25e-6300-443f-a41b-5041f95cb145 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:32.878657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cc25e-6300-443f-a41b-5041f95cb145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:32.880562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cc25e-6300-443f-a41b-5041f95cb145 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:32.908815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1225/2447] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:52:32 2021] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:52:32.913053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1a5b1-c681-4d91-8fcf-b2d27334f87f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:32.925424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1a5b1-c681-4d91-8fcf-b2d27334f87f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:32.983700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd81ba1-219b-479b-8db2-162341f205c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:32.984379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd81ba1-219b-479b-8db2-162341f205c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:32.984691 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd81ba1-219b-479b-8db2-162341f205c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:32.984966 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd81ba1-219b-479b-8db2-162341f205c8 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:32.985673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd81ba1-219b-479b-8db2-162341f205c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:32.987795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd81ba1-219b-479b-8db2-162341f205c8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:33.012383 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1223/2448] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:52:32 2021] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:52:33.013776 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cc25e-6300-443f-a41b-5041f95cb145 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:33.024017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cc25e-6300-443f-a41b-5041f95cb145 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:33.029302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5ecd0-8c80-4cc5-93f7-c7dbd8db3a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:33.030156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5ecd0-8c80-4cc5-93f7-c7dbd8db3a80 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:33.030532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5ecd0-8c80-4cc5-93f7-c7dbd8db3a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:33.030900 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5ecd0-8c80-4cc5-93f7-c7dbd8db3a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:33.031860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5ecd0-8c80-4cc5-93f7-c7dbd8db3a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:33.033716 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee5ecd0-8c80-4cc5-93f7-c7dbd8db3a80 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:33.048669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1226/2449] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:33 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:52:33.050780 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd81ba1-219b-479b-8db2-162341f205c8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:33.066914 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd81ba1-219b-479b-8db2-162341f205c8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:33.069557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acebc6-5055-48e5-b995-debdd31c83a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:33.070293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acebc6-5055-48e5-b995-debdd31c83a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:33.070573 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acebc6-5055-48e5-b995-debdd31c83a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:33.070945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acebc6-5055-48e5-b995-debdd31c83a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:33.071828 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acebc6-5055-48e5-b995-debdd31c83a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:33.073707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acebc6-5055-48e5-b995-debdd31c83a0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:33.085024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1224/2450] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:33 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:52:33.089105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5ecd0-8c80-4cc5-93f7-c7dbd8db3a80 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:33.099823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee5ecd0-8c80-4cc5-93f7-c7dbd8db3a80 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:33.104506 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ae74c-10f5-41d3-be32-df2549a2b89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:33.105429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ae74c-10f5-41d3-be32-df2549a2b89a admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:33.105717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ae74c-10f5-41d3-be32-df2549a2b89a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:33.106140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ae74c-10f5-41d3-be32-df2549a2b89a admin admin] PATH_INFO: `/v3/projects/acdcfcbacc3f4910aa7d2b153c04fb19/users/9f54f5bf17b1473da57a9c7d338c5368/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:33.121946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ae74c-10f5-41d3-be32-df2549a2b89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdcfcbacc3f4910aa7d2b153c04fb19, user_id=9f54f5bf17b1473da57a9c7d338c5368, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:33.124755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ae74c-10f5-41d3-be32-df2549a2b89a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:33.139489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1227/2451] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:52:33 2021] PUT /identity/v3/projects/acdcfcbacc3f4910aa7d2b153c04fb19/users/9f54f5bf17b1473da57a9c7d338c5368/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:33.150314 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde1a20-0bec-4a68-b926-532529b29610 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:33.150602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde1a20-0bec-4a68-b926-532529b29610 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:33.150884 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde1a20-0bec-4a68-b926-532529b29610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:33.189346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-0fde1a20-0bec-4a68-b926-532529b29610 None None] MFA Rules not processed for user `9f54f5bf17b1473da57a9c7d338c5368`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:33.191624 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0fde1a20-0bec-4a68-b926-532529b29610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:33.269778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1225/2452] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:33 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:33.274310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ae74c-10f5-41d3-be32-df2549a2b89a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:33.364125 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ae74c-10f5-41d3-be32-df2549a2b89a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:33.369540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707c7b-4055-4d40-835a-7826f54c5451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:33.370213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707c7b-4055-4d40-835a-7826f54c5451 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:33.370498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707c7b-4055-4d40-835a-7826f54c5451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:33.370773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707c7b-4055-4d40-835a-7826f54c5451 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:33.371480 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a707c7b-4055-4d40-835a-7826f54c5451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:33.373427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a707c7b-4055-4d40-835a-7826f54c5451 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:33.403466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1228/2453] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:52:33 2021] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:52:33.404660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde1a20-0bec-4a68-b926-532529b29610 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:33.416671 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde1a20-0bec-4a68-b926-532529b29610 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:33.472845 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372c479-20f2-48a8-9055-ce1dcb0554d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:33.473533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372c479-20f2-48a8-9055-ce1dcb0554d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:33.473824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372c479-20f2-48a8-9055-ce1dcb0554d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:33.474096 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2372c479-20f2-48a8-9055-ce1dcb0554d6 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:33.474817 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372c479-20f2-48a8-9055-ce1dcb0554d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:33.476776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2372c479-20f2-48a8-9055-ce1dcb0554d6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:33.503042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1226/2454] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:52:33 2021] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:52:33.504277 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707c7b-4055-4d40-835a-7826f54c5451 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:33.514448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707c7b-4055-4d40-835a-7826f54c5451 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:33.522597 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63651f1e-9a9e-42f0-92a0-85f76aec03fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:33.523433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63651f1e-9a9e-42f0-92a0-85f76aec03fe admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:33.523712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63651f1e-9a9e-42f0-92a0-85f76aec03fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:33.524025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63651f1e-9a9e-42f0-92a0-85f76aec03fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:33.525152 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63651f1e-9a9e-42f0-92a0-85f76aec03fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:33.527088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63651f1e-9a9e-42f0-92a0-85f76aec03fe admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:33.540484 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1229/2455] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:33 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:52:33.545158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372c479-20f2-48a8-9055-ce1dcb0554d6 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:33.556308 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2372c479-20f2-48a8-9055-ce1dcb0554d6 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:33.561595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1acf-d56e-4537-a497-c5314d513990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:33.562513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1acf-d56e-4537-a497-c5314d513990 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:33.562793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1acf-d56e-4537-a497-c5314d513990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:33.563066 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a1acf-d56e-4537-a497-c5314d513990 admin admin] PATH_INFO: `/v3/projects/e1d44dd164de4ebbad46197d80271be7/users/ae292e265cad4b03affa9ebf77b3a9dd/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:33.581716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a1acf-d56e-4537-a497-c5314d513990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d44dd164de4ebbad46197d80271be7, user_id=ae292e265cad4b03affa9ebf77b3a9dd, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:33.585379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a1acf-d56e-4537-a497-c5314d513990 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:33.600471 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1227/2456] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:52:33 2021] PUT /identity/v3/projects/e1d44dd164de4ebbad46197d80271be7/users/ae292e265cad4b03affa9ebf77b3a9dd/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:33.604599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63651f1e-9a9e-42f0-92a0-85f76aec03fe admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:33.615738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63651f1e-9a9e-42f0-92a0-85f76aec03fe admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:33.682102 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cbc69-4492-4d0d-9b02-bff7e76254f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:33.682686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cbc69-4492-4d0d-9b02-bff7e76254f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:33.682961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cbc69-4492-4d0d-9b02-bff7e76254f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:33.683229 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cbc69-4492-4d0d-9b02-bff7e76254f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:33.683977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cbc69-4492-4d0d-9b02-bff7e76254f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:33.685644 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cbc69-4492-4d0d-9b02-bff7e76254f9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:33.699701 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1230/2457] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:33 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:52:33.704051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1acf-d56e-4537-a497-c5314d513990 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:33.716936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a1acf-d56e-4537-a497-c5314d513990 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:33.722137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2edea-f8ab-4f30-b545-4a70725afc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:33.723045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2edea-f8ab-4f30-b545-4a70725afc8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:33.723331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2edea-f8ab-4f30-b545-4a70725afc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:33.723610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2edea-f8ab-4f30-b545-4a70725afc8b admin admin] PATH_INFO: `/v3/projects/e1d44dd164de4ebbad46197d80271be7/users/ae292e265cad4b03affa9ebf77b3a9dd/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:33.725839 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2edea-f8ab-4f30-b545-4a70725afc8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1d44dd164de4ebbad46197d80271be7, user_id=ae292e265cad4b03affa9ebf77b3a9dd, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:33.728495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2edea-f8ab-4f30-b545-4a70725afc8b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:33.741965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1228/2458] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:52:33 2021] PUT /identity/v3/projects/e1d44dd164de4ebbad46197d80271be7/users/ae292e265cad4b03affa9ebf77b3a9dd/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:33.759211 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26317-b075-4682-a3b0-5df2d15b8de8 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:33.759696 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26317-b075-4682-a3b0-5df2d15b8de8 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:33.760165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a26317-b075-4682-a3b0-5df2d15b8de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:33.802957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-99a26317-b075-4682-a3b0-5df2d15b8de8 None None] MFA Rules not processed for user `ae292e265cad4b03affa9ebf77b3a9dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:33.805110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-99a26317-b075-4682-a3b0-5df2d15b8de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:33.906888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1231/2459] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:33 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:33.919410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2edea-f8ab-4f30-b545-4a70725afc8b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:33.923325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-37a2edea-f8ab-4f30-b545-4a70725afc8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:34.018057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2edea-f8ab-4f30-b545-4a70725afc8b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:34.027650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d8f34-dd21-4d2b-b7a6-9afbe85ba86a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:34.028776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d8f34-dd21-4d2b-b7a6-9afbe85ba86a service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:34.029071 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d8f34-dd21-4d2b-b7a6-9afbe85ba86a service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:34.029348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d8f34-dd21-4d2b-b7a6-9afbe85ba86a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:34.041055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d8f34-dd21-4d2b-b7a6-9afbe85ba86a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:34.042523 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d8f34-dd21-4d2b-b7a6-9afbe85ba86a service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:34.057270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1229/2460] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:52:33 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:52:34.343847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7faa-2bb5-4778-9e9c-ddf1a0371a08 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:34.344487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7faa-2bb5-4778-9e9c-ddf1a0371a08 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:34.344487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc7faa-2bb5-4778-9e9c-ddf1a0371a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:34.367841 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-f3fc7faa-2bb5-4778-9e9c-ddf1a0371a08 None None] MFA Rules not processed for user `e9c2500682e64b3a91e811a3ba09bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:34.370968 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f3fc7faa-2bb5-4778-9e9c-ddf1a0371a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:34.444030 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1232/2461] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:34 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:35.543709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d8f34-dd21-4d2b-b7a6-9afbe85ba86a service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:35.610639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d8f34-dd21-4d2b-b7a6-9afbe85ba86a service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:35.616704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:35.617854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:35.618144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:35.618458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] PATH_INFO: `/v3/users/9f54f5bf17b1473da57a9c7d338c5368` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:35.619928 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f54f5bf17b1473da57a9c7d338c5368)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:35.622743 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:35.674766 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f54f5bf17b1473da57a9c7d338c5368'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:35.688091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f54f5bf17b1473da57a9c7d338c5368'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:35.696118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f54f5bf17b1473da57a9c7d338c5368'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:35.703030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f54f5bf17b1473da57a9c7d338c5368'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:35.703661 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f54f5bf17b1473da57a9c7d338c5368'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:35.710011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1230/2462] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:52:35 2021] DELETE /identity/v3/users/9f54f5bf17b1473da57a9c7d338c5368 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:35.714595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620386e4-f505-4e5b-b22c-c25fcc425a52 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:35.715080 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620386e4-f505-4e5b-b22c-c25fcc425a52 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:35.715160 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620386e4-f505-4e5b-b22c-c25fcc425a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:35.733577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-620386e4-f505-4e5b-b22c-c25fcc425a52 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:35.734771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-620386e4-f505-4e5b-b22c-c25fcc425a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:35.795726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1233/2463] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:52:35.805856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:35.807327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:35.867163 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7433644-ef74-4a5f-a516-975b162136f6 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:35.871650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ad9ad-ca59-43d7-a380-dd98c5afe51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:35.872279 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad9ad-ca59-43d7-a380-dd98c5afe51b service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:35.872554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad9ad-ca59-43d7-a380-dd98c5afe51b service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:35.872864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad9ad-ca59-43d7-a380-dd98c5afe51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:35.883421 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ad9ad-ca59-43d7-a380-dd98c5afe51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:35.884967 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ad9ad-ca59-43d7-a380-dd98c5afe51b service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:35.896241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1231/2464] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:52:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:52:36.196011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620386e4-f505-4e5b-b22c-c25fcc425a52 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:36.197510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-620386e4-f505-4e5b-b22c-c25fcc425a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:36.219798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620386e4-f505-4e5b-b22c-c25fcc425a52 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:36.232541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:36.233450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:36.233727 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:36.233997 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] PATH_INFO: `/v3/projects/acdcfcbacc3f4910aa7d2b153c04fb19` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:36.235499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdcfcbacc3f4910aa7d2b153c04fb19)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:36.237371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:36.316392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdcfcbacc3f4910aa7d2b153c04fb19', 'request_id': 'req-9a642368-80a0-42dd-8fd0-caad2dbcef0d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:36.336801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdcfcbacc3f4910aa7d2b153c04fb19', 'request_id': 'req-9a642368-80a0-42dd-8fd0-caad2dbcef0d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:36.336801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdcfcbacc3f4910aa7d2b153c04fb19', 'request_id': 'req-9a642368-80a0-42dd-8fd0-caad2dbcef0d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:36.344761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] The token cache is being invalidate because project acdcfcbacc3f4910aa7d2b153c04fb19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:52:36.345054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:36.345773 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:36.347592 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1234/2465] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:52:36 2021] DELETE /identity/v3/projects/acdcfcbacc3f4910aa7d2b153c04fb19 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:36.351699 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ad9ad-ca59-43d7-a380-dd98c5afe51b service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:36.361628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ad9ad-ca59-43d7-a380-dd98c5afe51b service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:36.417098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e9bbc-e651-42c4-af93-ec37983cb5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:36.418007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e9bbc-e651-42c4-af93-ec37983cb5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:36.418260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e9bbc-e651-42c4-af93-ec37983cb5af admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:36.418530 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e9bbc-e651-42c4-af93-ec37983cb5af admin admin] PATH_INFO: `/v3/users/ae292e265cad4b03affa9ebf77b3a9dd` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:36.419986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e9bbc-e651-42c4-af93-ec37983cb5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae292e265cad4b03affa9ebf77b3a9dd)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:36.421904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e9bbc-e651-42c4-af93-ec37983cb5af admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:36.469232 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-aa6e9bbc-e651-42c4-af93-ec37983cb5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae292e265cad4b03affa9ebf77b3a9dd'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:36.481132 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-aa6e9bbc-e651-42c4-af93-ec37983cb5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae292e265cad4b03affa9ebf77b3a9dd'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:36.490160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-aa6e9bbc-e651-42c4-af93-ec37983cb5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae292e265cad4b03affa9ebf77b3a9dd'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:36.497835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-aa6e9bbc-e651-42c4-af93-ec37983cb5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae292e265cad4b03affa9ebf77b3a9dd'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:36.498517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-aa6e9bbc-e651-42c4-af93-ec37983cb5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae292e265cad4b03affa9ebf77b3a9dd'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:36.504437 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1232/2466] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:52:36 2021] DELETE /identity/v3/users/ae292e265cad4b03affa9ebf77b3a9dd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:36.923209 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:36.925669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:36.939356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a642368-80a0-42dd-8fd0-caad2dbcef0d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:37.035651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:37.036652 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:37.037038 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:37.037430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] PATH_INFO: `/v3/projects/e1d44dd164de4ebbad46197d80271be7` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:37.038878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1d44dd164de4ebbad46197d80271be7)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:37.041006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:37.095350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1d44dd164de4ebbad46197d80271be7', 'request_id': 'req-42f8b458-ec42-4e36-a0b4-59e333eed1ca'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:37.108460 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1d44dd164de4ebbad46197d80271be7', 'request_id': 'req-42f8b458-ec42-4e36-a0b4-59e333eed1ca'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:37.117157 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1d44dd164de4ebbad46197d80271be7', 'request_id': 'req-42f8b458-ec42-4e36-a0b4-59e333eed1ca'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:37.134103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] The token cache is being invalidate because project e1d44dd164de4ebbad46197d80271be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:52:37.134461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:37.135192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-42f8b458-ec42-4e36-a0b4-59e333eed1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:37.137858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1235/2467] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:52:36 2021] DELETE /identity/v3/projects/e1d44dd164de4ebbad46197d80271be7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:37.143246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89f3a2-ca3d-4c8c-a969-5f51a948b0e8 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:37.143739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89f3a2-ca3d-4c8c-a969-5f51a948b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:37.143952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa89f3a2-ca3d-4c8c-a969-5f51a948b0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:37.171760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-aa89f3a2-ca3d-4c8c-a969-5f51a948b0e8 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:37.173142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-aa89f3a2-ca3d-4c8c-a969-5f51a948b0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:37.272907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1233/2468] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:37.277816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c46f2-0cb8-49b0-8699-b471d5fa46e8 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:37.278106 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c46f2-0cb8-49b0-8699-b471d5fa46e8 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:37.278387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c46f2-0cb8-49b0-8699-b471d5fa46e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:37.302410 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-6c5c46f2-0cb8-49b0-8699-b471d5fa46e8 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:37.304045 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6c5c46f2-0cb8-49b0-8699-b471d5fa46e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:37.315658 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1236/2469] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:37.321125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89f3a2-ca3d-4c8c-a969-5f51a948b0e8 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:37.331203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa89f3a2-ca3d-4c8c-a969-5f51a948b0e8 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:37.336597 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ed8a7-4b76-4adf-8f33-f0bc1b7cf4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:37.339259 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ed8a7-4b76-4adf-8f33-f0bc1b7cf4de admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:37.339636 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ed8a7-4b76-4adf-8f33-f0bc1b7cf4de admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:37.340034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924ed8a7-4b76-4adf-8f33-f0bc1b7cf4de admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:37.341015 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ed8a7-4b76-4adf-8f33-f0bc1b7cf4de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:52:37.341539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ed8a7-4b76-4adf-8f33-f0bc1b7cf4de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:37.343647 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924ed8a7-4b76-4adf-8f33-f0bc1b7cf4de admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:37.361929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1234/2470] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:52:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:52:37.363865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c46f2-0cb8-49b0-8699-b471d5fa46e8 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:37.373534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5c46f2-0cb8-49b0-8699-b471d5fa46e8 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:37.379719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476c9ca-7231-4680-b99d-23e05b38fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:37.380386 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476c9ca-7231-4680-b99d-23e05b38fae6 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:37.380712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476c9ca-7231-4680-b99d-23e05b38fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:37.380975 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476c9ca-7231-4680-b99d-23e05b38fae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:37.381712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476c9ca-7231-4680-b99d-23e05b38fae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:37.383617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476c9ca-7231-4680-b99d-23e05b38fae6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:37.417959 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1237/2471] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:52:37 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:52:37.419417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ed8a7-4b76-4adf-8f33-f0bc1b7cf4de admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:37.430552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924ed8a7-4b76-4adf-8f33-f0bc1b7cf4de admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:37.492615 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b31543-b845-43d9-b039-99a64f8fd72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:37.493321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b31543-b845-43d9-b039-99a64f8fd72f admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:37.493908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b31543-b845-43d9-b039-99a64f8fd72f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:37.494200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b31543-b845-43d9-b039-99a64f8fd72f admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:37.495167 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b31543-b845-43d9-b039-99a64f8fd72f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:37.497331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b31543-b845-43d9-b039-99a64f8fd72f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:37.522107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1235/2472] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:52:37 2021] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:52:37.525378 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476c9ca-7231-4680-b99d-23e05b38fae6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:37.537204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476c9ca-7231-4680-b99d-23e05b38fae6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:37.543089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81b17d-3b51-4860-9038-6baa706b831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:37.543924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81b17d-3b51-4860-9038-6baa706b831d admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:37.544296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81b17d-3b51-4860-9038-6baa706b831d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:37.544799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81b17d-3b51-4860-9038-6baa706b831d admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:37.545824 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81b17d-3b51-4860-9038-6baa706b831d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:37.547650 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81b17d-3b51-4860-9038-6baa706b831d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:37.564515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1238/2473] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:37 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:52:37.565928 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b31543-b845-43d9-b039-99a64f8fd72f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:37.578392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b31543-b845-43d9-b039-99a64f8fd72f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:37.584382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449d04-a5fd-4eed-aaa7-829c08acc00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:37.585723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449d04-a5fd-4eed-aaa7-829c08acc00d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:37.586092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449d04-a5fd-4eed-aaa7-829c08acc00d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:37.586435 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449d04-a5fd-4eed-aaa7-829c08acc00d admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:37.587268 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5449d04-a5fd-4eed-aaa7-829c08acc00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:37.588992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5449d04-a5fd-4eed-aaa7-829c08acc00d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:37.600263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1236/2474] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:37 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:52:37.604626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81b17d-3b51-4860-9038-6baa706b831d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:37.617452 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81b17d-3b51-4860-9038-6baa706b831d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:37.624153 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f42a58-178a-459d-8e36-8d3b5330e1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:37.625171 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f42a58-178a-459d-8e36-8d3b5330e1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:37.625678 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f42a58-178a-459d-8e36-8d3b5330e1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:37.626281 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f42a58-178a-459d-8e36-8d3b5330e1e9 admin admin] PATH_INFO: `/v3/projects/884051d4431644328a8919adc2399c69/users/ccbe3dfa3ddf40e5bb6e3355062bc26e/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:37.653210 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f42a58-178a-459d-8e36-8d3b5330e1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884051d4431644328a8919adc2399c69, user_id=ccbe3dfa3ddf40e5bb6e3355062bc26e, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:37.656613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f42a58-178a-459d-8e36-8d3b5330e1e9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:37.673226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1239/2475] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:52:37 2021] PUT /identity/v3/projects/884051d4431644328a8919adc2399c69/users/ccbe3dfa3ddf40e5bb6e3355062bc26e/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:37.683778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2744b3c-bfd9-41aa-a7d8-196434903f61 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:37.684328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2744b3c-bfd9-41aa-a7d8-196434903f61 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:37.684808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2744b3c-bfd9-41aa-a7d8-196434903f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:37.713410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-e2744b3c-bfd9-41aa-a7d8-196434903f61 None None] MFA Rules not processed for user `ccbe3dfa3ddf40e5bb6e3355062bc26e`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:37.714951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e2744b3c-bfd9-41aa-a7d8-196434903f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:37.807790 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1237/2476] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:37 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:37.812025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f42a58-178a-459d-8e36-8d3b5330e1e9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:37.891605 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f42a58-178a-459d-8e36-8d3b5330e1e9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:37.897114 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5952-28b8-44f6-97be-bd3fac19d276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:37.897820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5952-28b8-44f6-97be-bd3fac19d276 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:37.898108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5952-28b8-44f6-97be-bd3fac19d276 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:37.898383 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b5952-28b8-44f6-97be-bd3fac19d276 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:37.899110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b5952-28b8-44f6-97be-bd3fac19d276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:37.901074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b5952-28b8-44f6-97be-bd3fac19d276 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:37.931260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1240/2477] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:52:37 2021] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:52:37.935270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2744b3c-bfd9-41aa-a7d8-196434903f61 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:37.949833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2744b3c-bfd9-41aa-a7d8-196434903f61 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:38.016508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c9837-c428-43e1-83f5-db6eabf05b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:38.017242 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9837-c428-43e1-83f5-db6eabf05b4d admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:38.017610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9837-c428-43e1-83f5-db6eabf05b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:38.017860 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c9837-c428-43e1-83f5-db6eabf05b4d admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:38.018684 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c9837-c428-43e1-83f5-db6eabf05b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:38.020618 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c9837-c428-43e1-83f5-db6eabf05b4d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:38.044082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1238/2478] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:52:37 2021] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:52:38.049320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5952-28b8-44f6-97be-bd3fac19d276 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:38.061022 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b5952-28b8-44f6-97be-bd3fac19d276 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:38.067324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21952912-e047-4265-882f-bd6292a0e005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:38.068024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21952912-e047-4265-882f-bd6292a0e005 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:38.068302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21952912-e047-4265-882f-bd6292a0e005 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:38.068596 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21952912-e047-4265-882f-bd6292a0e005 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:38.069370 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21952912-e047-4265-882f-bd6292a0e005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:38.070978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21952912-e047-4265-882f-bd6292a0e005 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:38.082691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1241/2479] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:38 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:52:38.087206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c9837-c428-43e1-83f5-db6eabf05b4d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:38.100359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c9837-c428-43e1-83f5-db6eabf05b4d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:38.107518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfafc0-58ea-4593-a2eb-640059806e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:38.108446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfafc0-58ea-4593-a2eb-640059806e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:38.108782 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfafc0-58ea-4593-a2eb-640059806e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:38.109059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfafc0-58ea-4593-a2eb-640059806e75 admin admin] PATH_INFO: `/v3/projects/61e881d7a3264b6d8504263641f6b637/users/29a510bf85064362bcdcd74a0c3843ac/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:38.126656 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfafc0-58ea-4593-a2eb-640059806e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e881d7a3264b6d8504263641f6b637, user_id=29a510bf85064362bcdcd74a0c3843ac, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:38.131046 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cfafc0-58ea-4593-a2eb-640059806e75 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:38.147719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1239/2480] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:52:38 2021] PUT /identity/v3/projects/61e881d7a3264b6d8504263641f6b637/users/29a510bf85064362bcdcd74a0c3843ac/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:38.153913 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21952912-e047-4265-882f-bd6292a0e005 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:38.166626 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21952912-e047-4265-882f-bd6292a0e005 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:38.238202 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4548661-d7ca-41a2-a4b9-47efe54417ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:38.238882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548661-d7ca-41a2-a4b9-47efe54417ea admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:38.239514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548661-d7ca-41a2-a4b9-47efe54417ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:38.239788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4548661-d7ca-41a2-a4b9-47efe54417ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:38.240536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4548661-d7ca-41a2-a4b9-47efe54417ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:38.242188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4548661-d7ca-41a2-a4b9-47efe54417ea admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:38.253300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1242/2481] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:38 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:52:38.258026 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfafc0-58ea-4593-a2eb-640059806e75 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:38.269030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfafc0-58ea-4593-a2eb-640059806e75 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:38.274382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a20455-f41f-4c20-a1b7-10d76510d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:38.275302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a20455-f41f-4c20-a1b7-10d76510d675 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:38.275585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a20455-f41f-4c20-a1b7-10d76510d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:38.275853 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a20455-f41f-4c20-a1b7-10d76510d675 admin admin] PATH_INFO: `/v3/projects/61e881d7a3264b6d8504263641f6b637/users/29a510bf85064362bcdcd74a0c3843ac/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:38.278307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a20455-f41f-4c20-a1b7-10d76510d675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e881d7a3264b6d8504263641f6b637, user_id=29a510bf85064362bcdcd74a0c3843ac, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:38.281164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a20455-f41f-4c20-a1b7-10d76510d675 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:38.293739 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1240/2482] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:52:38 2021] PUT /identity/v3/projects/61e881d7a3264b6d8504263641f6b637/users/29a510bf85064362bcdcd74a0c3843ac/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:38.304951 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5251-dcc3-42b5-8187-cbcd8310790b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:38.305341 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5251-dcc3-42b5-8187-cbcd8310790b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:38.305713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f5251-dcc3-42b5-8187-cbcd8310790b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:38.340115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-2f8f5251-dcc3-42b5-8187-cbcd8310790b None None] MFA Rules not processed for user `29a510bf85064362bcdcd74a0c3843ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:38.341356 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-2f8f5251-dcc3-42b5-8187-cbcd8310790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:38.426092 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1243/2483] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:38 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:38.439425 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a20455-f41f-4c20-a1b7-10d76510d675 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:38.441567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d1a20455-f41f-4c20-a1b7-10d76510d675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:38.520036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a20455-f41f-4c20-a1b7-10d76510d675 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:38.526643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406de92b-a097-4be1-8034-5f7fc36f380a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:38.527394 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406de92b-a097-4be1-8034-5f7fc36f380a service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:38.527663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406de92b-a097-4be1-8034-5f7fc36f380a service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:38.528115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406de92b-a097-4be1-8034-5f7fc36f380a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:38.541082 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406de92b-a097-4be1-8034-5f7fc36f380a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:38.542747 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406de92b-a097-4be1-8034-5f7fc36f380a service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:38.553770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1241/2484] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:52:38 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:52:38.887847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f5251-dcc3-42b5-8187-cbcd8310790b None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:38.898228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f5251-dcc3-42b5-8187-cbcd8310790b None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:38.912927 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b10a1d-b169-449b-a9bf-b08d931c393e tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29a510bf85064362bcdcd74a0c3843ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61e881d7a3264b6d8504263641f6b637', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:38.912927 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10a1d-b169-449b-a9bf-b08d931c393e tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:38.912927 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10a1d-b169-449b-a9bf-b08d931c393e tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:38.913296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b10a1d-b169-449b-a9bf-b08d931c393e tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:38.913296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b10a1d-b169-449b-a9bf-b08d931c393e tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:52:38.913296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b10a1d-b169-449b-a9bf-b08d931c393e tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:38.913296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b10a1d-b169-449b-a9bf-b08d931c393e tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:38.921121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1244/2485] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:52:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:52:38.925391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406de92b-a097-4be1-8034-5f7fc36f380a service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:38.934522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406de92b-a097-4be1-8034-5f7fc36f380a service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:38.939204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40118ef-50f4-4b25-b238-407ba7479b05 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29a510bf85064362bcdcd74a0c3843ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61e881d7a3264b6d8504263641f6b637', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:38.940115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40118ef-50f4-4b25-b238-407ba7479b05 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:38.940425 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40118ef-50f4-4b25-b238-407ba7479b05 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:38.940741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40118ef-50f4-4b25-b238-407ba7479b05 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:38.941442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40118ef-50f4-4b25-b238-407ba7479b05 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:38.943330 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40118ef-50f4-4b25-b238-407ba7479b05 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:38.973865 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1242/2486] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:52:38 2021] POST /identity/v3/projects => generated 353 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:52:38.978123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b10a1d-b169-449b-a9bf-b08d931c393e tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:38.988424 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b10a1d-b169-449b-a9bf-b08d931c393e tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:39.059236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fac4a5-59bd-4a42-ba21-9859fcccfbf4 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29a510bf85064362bcdcd74a0c3843ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61e881d7a3264b6d8504263641f6b637', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:39.059898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fac4a5-59bd-4a42-ba21-9859fcccfbf4 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:39.060186 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fac4a5-59bd-4a42-ba21-9859fcccfbf4 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:39.060463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fac4a5-59bd-4a42-ba21-9859fcccfbf4 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:39.061235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fac4a5-59bd-4a42-ba21-9859fcccfbf4 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:52:39.061547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fac4a5-59bd-4a42-ba21-9859fcccfbf4 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:39.063150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fac4a5-59bd-4a42-ba21-9859fcccfbf4 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:39.075827 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1245/2487] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:52:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:52:39.118502 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40118ef-50f4-4b25-b238-407ba7479b05 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:39.130108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40118ef-50f4-4b25-b238-407ba7479b05 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:39.136013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29a510bf85064362bcdcd74a0c3843ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61e881d7a3264b6d8504263641f6b637', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:39.136953 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:39.137262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:39.137526 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] PATH_INFO: `/v3/projects/219917d0051647fe887b3919558ff81a` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:39.138857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: Authorizing `identity:delete_project(project_id=219917d0051647fe887b3919558ff81a)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:39.140807 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:39.195850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219917d0051647fe887b3919558ff81a', 'request_id': 'req-55b2f82a-f102-4553-9ac9-340c13fd60a0'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:39.206452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219917d0051647fe887b3919558ff81a', 'request_id': 'req-55b2f82a-f102-4553-9ac9-340c13fd60a0'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:39.213033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219917d0051647fe887b3919558ff81a', 'request_id': 'req-55b2f82a-f102-4553-9ac9-340c13fd60a0'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:39.223922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] The token cache is being invalidate because project 219917d0051647fe887b3919558ff81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:52:39.224203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:39.225008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-55b2f82a-f102-4553-9ac9-340c13fd60a0 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:39.226697 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1243/2488] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:52:39 2021] DELETE /identity/v3/projects/219917d0051647fe887b3919558ff81a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:39.471857 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fac4a5-59bd-4a42-ba21-9859fcccfbf4 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:39.474493 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-61fac4a5-59bd-4a42-ba21-9859fcccfbf4 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:39.550901 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fac4a5-59bd-4a42-ba21-9859fcccfbf4 tempest-VolumeQuotaClassesTest-1165005835 tempest-VolumeQuotaClassesTest-1165005835-project-admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:39.611847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:39.612893 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:39.613262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:39.613530 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] PATH_INFO: `/v3/users/ccbe3dfa3ddf40e5bb6e3355062bc26e` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:39.615393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccbe3dfa3ddf40e5bb6e3355062bc26e)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:39.617522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:39.671922 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccbe3dfa3ddf40e5bb6e3355062bc26e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:39.684949 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccbe3dfa3ddf40e5bb6e3355062bc26e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:39.685662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccbe3dfa3ddf40e5bb6e3355062bc26e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:39.693017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccbe3dfa3ddf40e5bb6e3355062bc26e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:39.702831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccbe3dfa3ddf40e5bb6e3355062bc26e'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:39.708847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1246/2489] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:52:39 2021] DELETE /identity/v3/users/ccbe3dfa3ddf40e5bb6e3355062bc26e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:39.714662 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68600-63e0-48cc-b453-a8b4bde9562a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:39.715066 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68600-63e0-48cc-b453-a8b4bde9562a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:39.715392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c68600-63e0-48cc-b453-a8b4bde9562a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:39.742122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-17c68600-63e0-48cc-b453-a8b4bde9562a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:39.743324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-17c68600-63e0-48cc-b453-a8b4bde9562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:39.800888 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1244/2490] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:39.811919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:39.814376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:39.877722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a8e92-a7be-4ca9-955b-708cb2d1a931 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:39.881898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f9ae9-98e1-4bc6-99a3-c9ca1626f814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:39.882537 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f9ae9-98e1-4bc6-99a3-c9ca1626f814 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:39.882815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f9ae9-98e1-4bc6-99a3-c9ca1626f814 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:39.883083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f9ae9-98e1-4bc6-99a3-c9ca1626f814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:39.892429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f9ae9-98e1-4bc6-99a3-c9ca1626f814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:39.894502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f9ae9-98e1-4bc6-99a3-c9ca1626f814 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:39.908173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1247/2491] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:52:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:52:40.197094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c68600-63e0-48cc-b453-a8b4bde9562a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:40.198631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-17c68600-63e0-48cc-b453-a8b4bde9562a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:40.211627 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c68600-63e0-48cc-b453-a8b4bde9562a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:40.217233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:40.218072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:40.218526 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:40.218803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] PATH_INFO: `/v3/projects/884051d4431644328a8919adc2399c69` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:40.220019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=884051d4431644328a8919adc2399c69)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:40.222161 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:40.284331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884051d4431644328a8919adc2399c69', 'request_id': 'req-4cffc449-1e85-4693-9130-840e0c71ff23'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.295821 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884051d4431644328a8919adc2399c69', 'request_id': 'req-4cffc449-1e85-4693-9130-840e0c71ff23'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.302587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884051d4431644328a8919adc2399c69', 'request_id': 'req-4cffc449-1e85-4693-9130-840e0c71ff23'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.312747 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] The token cache is being invalidate because project 884051d4431644328a8919adc2399c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:52:40.313035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.313681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.315340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1245/2492] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:52:40 2021] DELETE /identity/v3/projects/884051d4431644328a8919adc2399c69 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:40.319713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f9ae9-98e1-4bc6-99a3-c9ca1626f814 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:40.329923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f9ae9-98e1-4bc6-99a3-c9ca1626f814 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:40.394108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ffe92-c003-4ee5-adb2-0e75a9f8e385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:40.394972 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffe92-c003-4ee5-adb2-0e75a9f8e385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:40.395242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffe92-c003-4ee5-adb2-0e75a9f8e385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:40.395511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ffe92-c003-4ee5-adb2-0e75a9f8e385 admin admin] PATH_INFO: `/v3/users/29a510bf85064362bcdcd74a0c3843ac` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:40.396859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ffe92-c003-4ee5-adb2-0e75a9f8e385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a510bf85064362bcdcd74a0c3843ac)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:40.398778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ffe92-c003-4ee5-adb2-0e75a9f8e385 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:40.454665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-dd5ffe92-c003-4ee5-adb2-0e75a9f8e385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a510bf85064362bcdcd74a0c3843ac'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.467820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-dd5ffe92-c003-4ee5-adb2-0e75a9f8e385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a510bf85064362bcdcd74a0c3843ac'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.468685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-dd5ffe92-c003-4ee5-adb2-0e75a9f8e385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a510bf85064362bcdcd74a0c3843ac'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.477236 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-dd5ffe92-c003-4ee5-adb2-0e75a9f8e385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a510bf85064362bcdcd74a0c3843ac'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.487353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-dd5ffe92-c003-4ee5-adb2-0e75a9f8e385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a510bf85064362bcdcd74a0c3843ac'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.493811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1248/2493] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:52:40 2021] DELETE /identity/v3/users/29a510bf85064362bcdcd74a0c3843ac => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:40.788248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:40.792412 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:40.805644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc449-1e85-4693-9130-840e0c71ff23 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:40.867416 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:40.868383 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:40.868663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:40.868934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] PATH_INFO: `/v3/projects/61e881d7a3264b6d8504263641f6b637` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:40.870202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e881d7a3264b6d8504263641f6b637)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:40.872146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:40.920632 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e881d7a3264b6d8504263641f6b637', 'request_id': 'req-42036a7a-1f85-4f91-8200-7bbf0a6bf159'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.931621 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e881d7a3264b6d8504263641f6b637', 'request_id': 'req-42036a7a-1f85-4f91-8200-7bbf0a6bf159'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.938217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e881d7a3264b6d8504263641f6b637', 'request_id': 'req-42036a7a-1f85-4f91-8200-7bbf0a6bf159'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.953102 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] The token cache is being invalidate because project 61e881d7a3264b6d8504263641f6b637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:52:40.953387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.954122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-42036a7a-1f85-4f91-8200-7bbf0a6bf159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:40.955959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1246/2494] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:52:40 2021] DELETE /identity/v3/projects/61e881d7a3264b6d8504263641f6b637 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:40.961809 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3731225-b01f-41ea-ba9e-a1870111b99d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:40.962121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3731225-b01f-41ea-ba9e-a1870111b99d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:40.962392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3731225-b01f-41ea-ba9e-a1870111b99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:40.981368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-d3731225-b01f-41ea-ba9e-a1870111b99d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:40.982565 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d3731225-b01f-41ea-ba9e-a1870111b99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:41.046533 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1249/2495] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:41.055402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110649b-724e-495e-a6ee-8fe5bf2119da None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:41.055680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110649b-724e-495e-a6ee-8fe5bf2119da None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:41.055957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110649b-724e-495e-a6ee-8fe5bf2119da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:41.076771 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-9110649b-724e-495e-a6ee-8fe5bf2119da None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:41.077958 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9110649b-724e-495e-a6ee-8fe5bf2119da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:41.086422 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1247/2496] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:41.091620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3731225-b01f-41ea-ba9e-a1870111b99d None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:41.103026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3731225-b01f-41ea-ba9e-a1870111b99d None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:41.108908 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63a11a-f6be-4815-8900-f15a714a3465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:41.109771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a11a-f6be-4815-8900-f15a714a3465 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:41.109923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a11a-f6be-4815-8900-f15a714a3465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:41.110150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63a11a-f6be-4815-8900-f15a714a3465 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:41.110889 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a11a-f6be-4815-8900-f15a714a3465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:52:41.111427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a11a-f6be-4815-8900-f15a714a3465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:41.113770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63a11a-f6be-4815-8900-f15a714a3465 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:41.127724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1250/2497] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:52:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:52:41.134675 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110649b-724e-495e-a6ee-8fe5bf2119da None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:41.151054 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110649b-724e-495e-a6ee-8fe5bf2119da None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:41.166907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c3503-4862-41dc-86e0-42fe0308d569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:41.166907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c3503-4862-41dc-86e0-42fe0308d569 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:41.166907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c3503-4862-41dc-86e0-42fe0308d569 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:41.166907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c3503-4862-41dc-86e0-42fe0308d569 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:41.167844 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c3503-4862-41dc-86e0-42fe0308d569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:41.169553 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c3503-4862-41dc-86e0-42fe0308d569 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:41.203474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1248/2498] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:52:41 2021] POST /identity/v3/projects => generated 359 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:52:41.204780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63a11a-f6be-4815-8900-f15a714a3465 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:41.215095 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63a11a-f6be-4815-8900-f15a714a3465 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:41.274078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d94c2-4b61-4a17-9703-1af9d753c6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:41.274754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d94c2-4b61-4a17-9703-1af9d753c6cc admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:41.275033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d94c2-4b61-4a17-9703-1af9d753c6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:41.275301 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d94c2-4b61-4a17-9703-1af9d753c6cc admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:41.275993 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d94c2-4b61-4a17-9703-1af9d753c6cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:41.278412 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d94c2-4b61-4a17-9703-1af9d753c6cc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:41.307183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1251/2499] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:52:41 2021] POST /identity/v3/users => generated 280 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:52:41.311420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c3503-4862-41dc-86e0-42fe0308d569 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:41.326530 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c3503-4862-41dc-86e0-42fe0308d569 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:41.334660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eee2a-dfa5-46a1-bdfb-3a430315af43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:41.335709 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eee2a-dfa5-46a1-bdfb-3a430315af43 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:41.336161 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eee2a-dfa5-46a1-bdfb-3a430315af43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:41.336585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866eee2a-dfa5-46a1-bdfb-3a430315af43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:41.337783 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eee2a-dfa5-46a1-bdfb-3a430315af43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:41.340441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866eee2a-dfa5-46a1-bdfb-3a430315af43 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:41.353955 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1249/2500] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:41 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:52:41.358207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d94c2-4b61-4a17-9703-1af9d753c6cc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:41.370576 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d94c2-4b61-4a17-9703-1af9d753c6cc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:41.379372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ec9d2-f92a-4283-9894-73480a75fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:41.380030 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ec9d2-f92a-4283-9894-73480a75fd0f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:41.380308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ec9d2-f92a-4283-9894-73480a75fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:41.380593 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ec9d2-f92a-4283-9894-73480a75fd0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:41.381339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ec9d2-f92a-4283-9894-73480a75fd0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:41.382947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ec9d2-f92a-4283-9894-73480a75fd0f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:41.393363 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1252/2501] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:41 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:52:41.397587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eee2a-dfa5-46a1-bdfb-3a430315af43 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:41.407898 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866eee2a-dfa5-46a1-bdfb-3a430315af43 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:41.414234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48037-38ce-483f-a016-f07b7b258923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:41.415130 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48037-38ce-483f-a016-f07b7b258923 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:41.415408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48037-38ce-483f-a016-f07b7b258923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:41.415677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a48037-38ce-483f-a016-f07b7b258923 admin admin] PATH_INFO: `/v3/projects/941a8b1430724d209050dae0ebac07c1/users/7ad3118e52444639879b784e22f45cf9/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:41.432093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a48037-38ce-483f-a016-f07b7b258923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=941a8b1430724d209050dae0ebac07c1, user_id=7ad3118e52444639879b784e22f45cf9, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:41.434820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a48037-38ce-483f-a016-f07b7b258923 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:41.451492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1250/2502] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:52:41 2021] PUT /identity/v3/projects/941a8b1430724d209050dae0ebac07c1/users/7ad3118e52444639879b784e22f45cf9/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:41.467611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec2aef-be49-42f2-b9f7-1cdf55040bb7 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:41.467921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec2aef-be49-42f2-b9f7-1cdf55040bb7 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:41.468348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec2aef-be49-42f2-b9f7-1cdf55040bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:41.498523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a2ec2aef-be49-42f2-b9f7-1cdf55040bb7 None None] MFA Rules not processed for user `7ad3118e52444639879b784e22f45cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:41.499743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a2ec2aef-be49-42f2-b9f7-1cdf55040bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:41.579139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1253/2503] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:41 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:41.618284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48037-38ce-483f-a016-f07b7b258923 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:41.621643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a0a48037-38ce-483f-a016-f07b7b258923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:41.695618 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a48037-38ce-483f-a016-f07b7b258923 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:41.699755 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90152abb-6eb3-484e-9ede-770ced4a9fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:41.700429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152abb-6eb3-484e-9ede-770ced4a9fdf service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:41.700793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152abb-6eb3-484e-9ede-770ced4a9fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:41.701832 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90152abb-6eb3-484e-9ede-770ced4a9fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:41.711116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90152abb-6eb3-484e-9ede-770ced4a9fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:41.712599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90152abb-6eb3-484e-9ede-770ced4a9fdf service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:41.722488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1251/2504] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:52:41 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:52:41.736473 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec2aef-be49-42f2-b9f7-1cdf55040bb7 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:41.809087 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec2aef-be49-42f2-b9f7-1cdf55040bb7 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:41.813910 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:41.814788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:41.815066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:41.815337 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] PATH_INFO: `/v3/users/7ad3118e52444639879b784e22f45cf9` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:41.816917 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad3118e52444639879b784e22f45cf9)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:41.818997 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:41.868681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad3118e52444639879b784e22f45cf9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:41.880806 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad3118e52444639879b784e22f45cf9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:41.881645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad3118e52444639879b784e22f45cf9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:41.890625 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad3118e52444639879b784e22f45cf9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:41.906366 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad3118e52444639879b784e22f45cf9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:41.913968 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1254/2505] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:52:41 2021] DELETE /identity/v3/users/7ad3118e52444639879b784e22f45cf9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:41.919963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf405-ef25-4924-8897-15e0651bff24 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:41.920251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf405-ef25-4924-8897-15e0651bff24 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:41.920518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbf405-ef25-4924-8897-15e0651bff24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:41.941504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-dfcbf405-ef25-4924-8897-15e0651bff24 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:41.942772 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-dfcbf405-ef25-4924-8897-15e0651bff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:42.014380 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1252/2506] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:42.025332 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:42.026818 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:42.087743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde617d1-cf5c-4723-8c10-e61a8598ea93 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:42.091961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f07e7f-1468-41d0-a892-a5930496ae8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:42.092648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07e7f-1468-41d0-a892-a5930496ae8b service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:42.092934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07e7f-1468-41d0-a892-a5930496ae8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:42.093223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f07e7f-1468-41d0-a892-a5930496ae8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:42.103780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f07e7f-1468-41d0-a892-a5930496ae8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:42.105274 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f07e7f-1468-41d0-a892-a5930496ae8b service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:42.119874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1255/2507] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:52:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:52:42.421824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf405-ef25-4924-8897-15e0651bff24 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:42.423493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-dfcbf405-ef25-4924-8897-15e0651bff24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:42.436800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbf405-ef25-4924-8897-15e0651bff24 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:42.441825 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:42.442729 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:42.443479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:42.443479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] PATH_INFO: `/v3/projects/941a8b1430724d209050dae0ebac07c1` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:42.445903 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=941a8b1430724d209050dae0ebac07c1)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:42.448293 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:42.511476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941a8b1430724d209050dae0ebac07c1', 'request_id': 'req-397d0afc-cefd-454d-9488-e889b3419f9f'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:42.522916 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941a8b1430724d209050dae0ebac07c1', 'request_id': 'req-397d0afc-cefd-454d-9488-e889b3419f9f'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:42.529934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941a8b1430724d209050dae0ebac07c1', 'request_id': 'req-397d0afc-cefd-454d-9488-e889b3419f9f'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:42.544440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] The token cache is being invalidate because project 941a8b1430724d209050dae0ebac07c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:52:42.544733 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:42.545427 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-397d0afc-cefd-454d-9488-e889b3419f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:42.547108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1253/2508] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:52:42 2021] DELETE /identity/v3/projects/941a8b1430724d209050dae0ebac07c1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:42.554736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476668c-2efd-4b4a-ae0a-cafaff009e28 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:42.555302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476668c-2efd-4b4a-ae0a-cafaff009e28 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:42.555302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476668c-2efd-4b4a-ae0a-cafaff009e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:42.579442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-0476668c-2efd-4b4a-ae0a-cafaff009e28 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:42.582215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0476668c-2efd-4b4a-ae0a-cafaff009e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:42.647629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1256/2509] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:52:42.656858 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597352d-e6d5-484d-96cf-2fefba83fda3 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:42.657138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597352d-e6d5-484d-96cf-2fefba83fda3 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:42.657500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597352d-e6d5-484d-96cf-2fefba83fda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:42.683281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d597352d-e6d5-484d-96cf-2fefba83fda3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:42.684500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d597352d-e6d5-484d-96cf-2fefba83fda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:42.694177 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1254/2510] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:52:42.698607 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476668c-2efd-4b4a-ae0a-cafaff009e28 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:42.709002 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0476668c-2efd-4b4a-ae0a-cafaff009e28 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:42.715795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff0157-d173-42c2-a7be-d08c34120731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:42.716816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff0157-d173-42c2-a7be-d08c34120731 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:42.717286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff0157-d173-42c2-a7be-d08c34120731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:42.717589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff0157-d173-42c2-a7be-d08c34120731 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:42.718586 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff0157-d173-42c2-a7be-d08c34120731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:52:42.718990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff0157-d173-42c2-a7be-d08c34120731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:42.721075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff0157-d173-42c2-a7be-d08c34120731 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:42.736744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1257/2511] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:52:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:52:42.741930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597352d-e6d5-484d-96cf-2fefba83fda3 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:42.752458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597352d-e6d5-484d-96cf-2fefba83fda3 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:42.758506 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495525b-b44d-4e20-af4d-64e7868965f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:42.759187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495525b-b44d-4e20-af4d-64e7868965f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:42.759465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495525b-b44d-4e20-af4d-64e7868965f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:42.759738 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495525b-b44d-4e20-af4d-64e7868965f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:42.760482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495525b-b44d-4e20-af4d-64e7868965f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:42.762468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495525b-b44d-4e20-af4d-64e7868965f4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:42.804400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1255/2512] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:52:42 2021] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:52:42.809447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff0157-d173-42c2-a7be-d08c34120731 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:42.825323 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff0157-d173-42c2-a7be-d08c34120731 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:42.893602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b0cfc-abf8-42ca-bd03-35a8a7df87d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:42.893602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b0cfc-abf8-42ca-bd03-35a8a7df87d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:42.893602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b0cfc-abf8-42ca-bd03-35a8a7df87d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:42.893602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b0cfc-abf8-42ca-bd03-35a8a7df87d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:42.894368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b0cfc-abf8-42ca-bd03-35a8a7df87d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:42.896211 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b0cfc-abf8-42ca-bd03-35a8a7df87d5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:42.920253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1258/2513] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:52:42 2021] POST /identity/v3/users => generated 285 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:52:42.925107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495525b-b44d-4e20-af4d-64e7868965f4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:42.937318 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495525b-b44d-4e20-af4d-64e7868965f4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:42.942690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1bc8a-b43c-495f-a6b8-b23c09ba085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:42.943443 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1bc8a-b43c-495f-a6b8-b23c09ba085f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:42.943696 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1bc8a-b43c-495f-a6b8-b23c09ba085f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:42.943940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1bc8a-b43c-495f-a6b8-b23c09ba085f admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:42.944761 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1bc8a-b43c-495f-a6b8-b23c09ba085f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:42.946333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1bc8a-b43c-495f-a6b8-b23c09ba085f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:42.959097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1256/2514] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:42 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:52:42.963655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b0cfc-abf8-42ca-bd03-35a8a7df87d5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:42.973919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b0cfc-abf8-42ca-bd03-35a8a7df87d5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:42.978784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97156f-2937-412a-bf85-954b6401bc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:42.979394 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97156f-2937-412a-bf85-954b6401bc3e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:42.979674 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97156f-2937-412a-bf85-954b6401bc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:42.979946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97156f-2937-412a-bf85-954b6401bc3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:42.980732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97156f-2937-412a-bf85-954b6401bc3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:42.982340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97156f-2937-412a-bf85-954b6401bc3e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:42.993492 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1259/2515] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:52:42 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:52:42.998673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1bc8a-b43c-495f-a6b8-b23c09ba085f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:43.019825 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1bc8a-b43c-495f-a6b8-b23c09ba085f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:43.030975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100bea8-479f-46cb-a35e-e73ba78e98aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:43.032650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100bea8-479f-46cb-a35e-e73ba78e98aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:43.033123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100bea8-479f-46cb-a35e-e73ba78e98aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:43.033539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100bea8-479f-46cb-a35e-e73ba78e98aa admin admin] PATH_INFO: `/v3/projects/08b21eaa49f44f4a99c33572d975994d/users/5dac44cc8f86438fb189f9207fc348fb/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:43.064345 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100bea8-479f-46cb-a35e-e73ba78e98aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b21eaa49f44f4a99c33572d975994d, user_id=5dac44cc8f86438fb189f9207fc348fb, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:43.067296 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100bea8-479f-46cb-a35e-e73ba78e98aa admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:43.084685 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1257/2516] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:52:42 2021] PUT /identity/v3/projects/08b21eaa49f44f4a99c33572d975994d/users/5dac44cc8f86438fb189f9207fc348fb/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:43.095089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6b75f-6bca-423f-89e8-0250b4934de2 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:43.095401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6b75f-6bca-423f-89e8-0250b4934de2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:43.095711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6b75f-6bca-423f-89e8-0250b4934de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:43.125511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-54b6b75f-6bca-423f-89e8-0250b4934de2 None None] MFA Rules not processed for user `5dac44cc8f86438fb189f9207fc348fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:43.127110 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-54b6b75f-6bca-423f-89e8-0250b4934de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:43.203123 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1260/2517] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:43 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:52:43.217049 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100bea8-479f-46cb-a35e-e73ba78e98aa admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:43.219956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8100bea8-479f-46cb-a35e-e73ba78e98aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:43.308547 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100bea8-479f-46cb-a35e-e73ba78e98aa admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:43.312256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fda5d-09a0-4c7c-aff9-44a3daf384e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18f1422ce48e44ab85e6d5e10d1ea898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:43.312939 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fda5d-09a0-4c7c-aff9-44a3daf384e6 service glance] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:43.313221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fda5d-09a0-4c7c-aff9-44a3daf384e6 service glance] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:43.313492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fda5d-09a0-4c7c-aff9-44a3daf384e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:43.322579 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fda5d-09a0-4c7c-aff9-44a3daf384e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:43.323969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62fda5d-09a0-4c7c-aff9-44a3daf384e6 service glance] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:43.332917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1258/2518] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:52:43 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:52:52.864246 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6b75f-6bca-423f-89e8-0250b4934de2 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:52.865729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-54b6b75f-6bca-423f-89e8-0250b4934de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:52.971556 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6b75f-6bca-423f-89e8-0250b4934de2 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:52.976561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f1b8f-3a08-4998-bd48-8619d1ccd151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:52.978273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1b8f-3a08-4998-bd48-8619d1ccd151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:52.978695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1b8f-3a08-4998-bd48-8619d1ccd151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:52.979651 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1b8f-3a08-4998-bd48-8619d1ccd151 admin admin] PATH_INFO: `/v3/users/5ef49d5682214edf8f95293d0041aa85` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:52.980807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f1b8f-3a08-4998-bd48-8619d1ccd151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef49d5682214edf8f95293d0041aa85)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:52.982858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f1b8f-3a08-4998-bd48-8619d1ccd151 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:53.039386 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5e0f1b8f-3a08-4998-bd48-8619d1ccd151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef49d5682214edf8f95293d0041aa85'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:53.052451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5e0f1b8f-3a08-4998-bd48-8619d1ccd151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef49d5682214edf8f95293d0041aa85'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:53.053228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5e0f1b8f-3a08-4998-bd48-8619d1ccd151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef49d5682214edf8f95293d0041aa85'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:53.062371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5e0f1b8f-3a08-4998-bd48-8619d1ccd151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef49d5682214edf8f95293d0041aa85'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:53.071187 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5e0f1b8f-3a08-4998-bd48-8619d1ccd151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef49d5682214edf8f95293d0041aa85'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:53.077227 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1261/2519] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:52:52 2021] DELETE /identity/v3/users/5ef49d5682214edf8f95293d0041aa85 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:52:53.284868 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fda5d-09a0-4c7c-aff9-44a3daf384e6 service glance] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:52:53.305680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fda5d-09a0-4c7c-aff9-44a3daf384e6 service glance] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:52:53.388172 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:52:53.389196 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:53.389474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:53.389917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] PATH_INFO: `/v3/projects/a2582447f23e4d388146670235c51d91` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:53.391311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2582447f23e4d388146670235c51d91)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:52:53.393303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:52:53.440230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2582447f23e4d388146670235c51d91', 'request_id': 'req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:53.449956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2582447f23e4d388146670235c51d91', 'request_id': 'req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:53.458090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2582447f23e4d388146670235c51d91', 'request_id': 'req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:53.469645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] The token cache is being invalidate because project a2582447f23e4d388146670235c51d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:52:53.470056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:53.470744 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:52:53.472313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1259/2520] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:52:53 2021] DELETE /identity/v3/projects/a2582447f23e4d388146670235c51d91 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:52:57.016485 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3999d-1ea0-4e1c-a013-6efd00dfbc01 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:52:57.017042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3999d-1ea0-4e1c-a013-6efd00dfbc01 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:52:57.017134 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3999d-1ea0-4e1c-a013-6efd00dfbc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:52:57.035746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-53a3999d-1ea0-4e1c-a013-6efd00dfbc01 None None] MFA Rules not processed for user `c282fd140f5645ca89c2e64888ea1345`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:52:57.036984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-53a3999d-1ea0-4e1c-a013-6efd00dfbc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:52:57.095066 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1262/2521] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:52:57 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:53:10.683534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:10.685236 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:10.744708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab28ec-1adc-4ff6-bf25-0d34a9960c03 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:10.748458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d2d12-3f25-4bef-83d0-84c6e721504a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:10.749147 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d2d12-3f25-4bef-83d0-84c6e721504a service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:10.749425 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d2d12-3f25-4bef-83d0-84c6e721504a service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:10.749707 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d2d12-3f25-4bef-83d0-84c6e721504a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:10.751668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-bd8d2d12-3f25-4bef-83d0-84c6e721504a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:10.841409 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d2d12-3f25-4bef-83d0-84c6e721504a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:10.842868 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d2d12-3f25-4bef-83d0-84c6e721504a service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:10.854228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1260/2522] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:53:10 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:53:13.448525 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3999d-1ea0-4e1c-a013-6efd00dfbc01 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:13.450585 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-53a3999d-1ea0-4e1c-a013-6efd00dfbc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:13.465011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3999d-1ea0-4e1c-a013-6efd00dfbc01 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:13.469119 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12320348-9447-449c-9046-a233ac6cf5fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:13.469771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12320348-9447-449c-9046-a233ac6cf5fb service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:13.470136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12320348-9447-449c-9046-a233ac6cf5fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:13.470318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12320348-9447-449c-9046-a233ac6cf5fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:13.473861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-12320348-9447-449c-9046-a233ac6cf5fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:13.489583 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12320348-9447-449c-9046-a233ac6cf5fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:13.491308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12320348-9447-449c-9046-a233ac6cf5fb service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:13.503523 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1263/2523] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:53:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:53:16.826511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d2d12-3f25-4bef-83d0-84c6e721504a service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:16.828105 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-bd8d2d12-3f25-4bef-83d0-84c6e721504a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:16.893907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d2d12-3f25-4bef-83d0-84c6e721504a service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:16.898766 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:16.899641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:16.899922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:16.900194 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] PATH_INFO: `/v3/users/5dac44cc8f86438fb189f9207fc348fb` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:16.901407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dac44cc8f86438fb189f9207fc348fb)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:16.903320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:16.961139 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dac44cc8f86438fb189f9207fc348fb'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:53:16.973060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dac44cc8f86438fb189f9207fc348fb'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:53:16.983107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dac44cc8f86438fb189f9207fc348fb'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:53:16.990781 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dac44cc8f86438fb189f9207fc348fb'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:53:16.991442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dac44cc8f86438fb189f9207fc348fb'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:53:16.997385 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1261/2524] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:53:16 2021] DELETE /identity/v3/users/5dac44cc8f86438fb189f9207fc348fb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:53:17.002158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4520e3-e499-4e07-ba2d-84b544c32437 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:17.002710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4520e3-e499-4e07-ba2d-84b544c32437 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:17.002710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4520e3-e499-4e07-ba2d-84b544c32437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:17.022192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-2e4520e3-e499-4e07-ba2d-84b544c32437 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:53:17.023621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-2e4520e3-e499-4e07-ba2d-84b544c32437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:17.092834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1264/2525] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:53:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:53:17.103124 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:17.104796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:17.170137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2124e08-02cc-4470-b607-5e3410490935 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:17.175070 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2e948-838c-479e-a951-73488a01bc00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:17.175719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2e948-838c-479e-a951-73488a01bc00 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:17.175998 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2e948-838c-479e-a951-73488a01bc00 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:17.176270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2e948-838c-479e-a951-73488a01bc00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:17.186022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2e948-838c-479e-a951-73488a01bc00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:17.187454 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2e948-838c-479e-a951-73488a01bc00 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:17.197433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1262/2526] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:53:17 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:53:17.475180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4520e3-e499-4e07-ba2d-84b544c32437 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:17.479867 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-2e4520e3-e499-4e07-ba2d-84b544c32437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:17.492798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4520e3-e499-4e07-ba2d-84b544c32437 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:17.499529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:17.500342 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:17.500738 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:17.500929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] PATH_INFO: `/v3/projects/08b21eaa49f44f4a99c33572d975994d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:17.502499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b21eaa49f44f4a99c33572d975994d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:17.504319 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:17.558531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b21eaa49f44f4a99c33572d975994d', 'request_id': 'req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:53:17.568507 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b21eaa49f44f4a99c33572d975994d', 'request_id': 'req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:53:17.576186 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b21eaa49f44f4a99c33572d975994d', 'request_id': 'req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:53:17.588027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] The token cache is being invalidate because project 08b21eaa49f44f4a99c33572d975994d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:53:17.588193 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:53:17.588814 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6a41a36b-8d89-4e3e-ab52-7f091933b1c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:53:17.590635 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1265/2527] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:53:17 2021] DELETE /identity/v3/projects/08b21eaa49f44f4a99c33572d975994d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:53:17.596521 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6a52a-01b8-4c07-8f00-d337511586f0 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:17.596864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6a52a-01b8-4c07-8f00-d337511586f0 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:17.597077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6a52a-01b8-4c07-8f00-d337511586f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:17.616146 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-52d6a52a-01b8-4c07-8f00-d337511586f0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:53:17.617480 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-52d6a52a-01b8-4c07-8f00-d337511586f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:17.680752 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1263/2528] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:53:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:53:17.685057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53d7c-d3ba-4536-a27f-6b73983666cf None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:17.685338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53d7c-d3ba-4536-a27f-6b73983666cf None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:17.685613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca53d7c-d3ba-4536-a27f-6b73983666cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:17.705433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-2ca53d7c-d3ba-4536-a27f-6b73983666cf None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:53:17.706659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-2ca53d7c-d3ba-4536-a27f-6b73983666cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:17.715803 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1266/2529] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:53:17 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:53:17.720408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6a52a-01b8-4c07-8f00-d337511586f0 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:17.730984 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6a52a-01b8-4c07-8f00-d337511586f0 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:17.736914 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6284f0-9521-40b8-a4be-4579ec33bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:17.737920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6284f0-9521-40b8-a4be-4579ec33bf55 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:17.738200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6284f0-9521-40b8-a4be-4579ec33bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:17.738475 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6284f0-9521-40b8-a4be-4579ec33bf55 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:17.739218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6284f0-9521-40b8-a4be-4579ec33bf55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:53:17.739525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6284f0-9521-40b8-a4be-4579ec33bf55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:17.741165 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6284f0-9521-40b8-a4be-4579ec33bf55 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:17.756022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1264/2530] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:53:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:53:17.762422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca53d7c-d3ba-4536-a27f-6b73983666cf None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:17.776168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca53d7c-d3ba-4536-a27f-6b73983666cf None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:17.782220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e7fd2-b289-4018-b622-6ebc3b8a0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:17.782883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e7fd2-b289-4018-b622-6ebc3b8a0715 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:17.783159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e7fd2-b289-4018-b622-6ebc3b8a0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:17.783429 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e7fd2-b289-4018-b622-6ebc3b8a0715 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:17.784128 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e7fd2-b289-4018-b622-6ebc3b8a0715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:17.786067 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e7fd2-b289-4018-b622-6ebc3b8a0715 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:17.816488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1267/2531] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:53:17 2021] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:53:17.821150 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6284f0-9521-40b8-a4be-4579ec33bf55 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:17.831467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6284f0-9521-40b8-a4be-4579ec33bf55 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:17.898566 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f383-3b83-4bb2-ae7d-d7b926aa8d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:17.899206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f383-3b83-4bb2-ae7d-d7b926aa8d69 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:17.899493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f383-3b83-4bb2-ae7d-d7b926aa8d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:17.899770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2f383-3b83-4bb2-ae7d-d7b926aa8d69 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:17.900469 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2f383-3b83-4bb2-ae7d-d7b926aa8d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:17.902411 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2f383-3b83-4bb2-ae7d-d7b926aa8d69 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:17.925664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1265/2532] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:53:17 2021] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:53:17.929805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e7fd2-b289-4018-b622-6ebc3b8a0715 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:17.942019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e7fd2-b289-4018-b622-6ebc3b8a0715 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:17.947378 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6368f24-7271-4661-a39d-49c9fa8ce189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:17.947566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6368f24-7271-4661-a39d-49c9fa8ce189 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:17.947797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6368f24-7271-4661-a39d-49c9fa8ce189 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:17.948074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6368f24-7271-4661-a39d-49c9fa8ce189 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:17.949645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6368f24-7271-4661-a39d-49c9fa8ce189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:17.951402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6368f24-7271-4661-a39d-49c9fa8ce189 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:17.963466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1268/2533] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:53:17 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:53:17.967585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f383-3b83-4bb2-ae7d-d7b926aa8d69 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:17.977807 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2f383-3b83-4bb2-ae7d-d7b926aa8d69 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:17.983375 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923784e-b2a6-4abd-85b3-da892220c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:17.984059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923784e-b2a6-4abd-85b3-da892220c39e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:17.984346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923784e-b2a6-4abd-85b3-da892220c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:17.984659 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923784e-b2a6-4abd-85b3-da892220c39e admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:17.985429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923784e-b2a6-4abd-85b3-da892220c39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:17.987028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923784e-b2a6-4abd-85b3-da892220c39e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:17.998656 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1266/2534] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:53:17 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:53:18.002696 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6368f24-7271-4661-a39d-49c9fa8ce189 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:18.013220 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6368f24-7271-4661-a39d-49c9fa8ce189 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:18.021545 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f8e4-3915-4608-a9f3-b7f130758f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:18.022494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f8e4-3915-4608-a9f3-b7f130758f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:18.022795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f8e4-3915-4608-a9f3-b7f130758f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:18.023070 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f8e4-3915-4608-a9f3-b7f130758f98 admin admin] PATH_INFO: `/v3/projects/979a51fd9c744bc9a5b0d82595603a56/users/ec44be0e26b44a55910bdccc7c836d2b/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:18.038945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3f8e4-3915-4608-a9f3-b7f130758f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979a51fd9c744bc9a5b0d82595603a56, user_id=ec44be0e26b44a55910bdccc7c836d2b, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:18.041938 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3f8e4-3915-4608-a9f3-b7f130758f98 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:18.057167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1269/2535] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:53:18 2021] PUT /identity/v3/projects/979a51fd9c744bc9a5b0d82595603a56/users/ec44be0e26b44a55910bdccc7c836d2b/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:53:18.062440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69cd98-8738-4d90-afb5-11061b82b9a2 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:18.062727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69cd98-8738-4d90-afb5-11061b82b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:18.063027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69cd98-8738-4d90-afb5-11061b82b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:18.082516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-4b69cd98-8738-4d90-afb5-11061b82b9a2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:53:18.083718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-4b69cd98-8738-4d90-afb5-11061b82b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:18.150339 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1267/2536] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:53:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:53:18.163532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f8e4-3915-4608-a9f3-b7f130758f98 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:18.166260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-dbb3f8e4-3915-4608-a9f3-b7f130758f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:18.238547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f8e4-3915-4608-a9f3-b7f130758f98 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:18.242932 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fa8ce-9994-44b7-94a4-6475b9f3ea76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:18.243572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fa8ce-9994-44b7-94a4-6475b9f3ea76 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:18.243844 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fa8ce-9994-44b7-94a4-6475b9f3ea76 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:18.244113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fa8ce-9994-44b7-94a4-6475b9f3ea76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:18.258478 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fa8ce-9994-44b7-94a4-6475b9f3ea76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:18.260440 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3fa8ce-9994-44b7-94a4-6475b9f3ea76 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:18.275413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1270/2537] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:53:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:53:22.353086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f74abe-e669-474b-b8a8-c0c526c9c024 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:22.353824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f74abe-e669-474b-b8a8-c0c526c9c024 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:22.353824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f74abe-e669-474b-b8a8-c0c526c9c024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:22.387831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-19f74abe-e669-474b-b8a8-c0c526c9c024 None None] MFA Rules not processed for user `ec44be0e26b44a55910bdccc7c836d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:53:22.389063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-19f74abe-e669-474b-b8a8-c0c526c9c024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:22.461685 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1268/2538] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:53:22 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:53:22.466368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fa8ce-9994-44b7-94a4-6475b9f3ea76 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:22.476617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3fa8ce-9994-44b7-94a4-6475b9f3ea76 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:22.481815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010b198-7383-4885-ace5-31f1c6ab7c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:22.482400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010b198-7383-4885-ace5-31f1c6ab7c53 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:22.482679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010b198-7383-4885-ace5-31f1c6ab7c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:22.482976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010b198-7383-4885-ace5-31f1c6ab7c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:22.483683 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010b198-7383-4885-ace5-31f1c6ab7c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:22.485660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010b198-7383-4885-ace5-31f1c6ab7c53 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:22.515504 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1271/2539] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:53:22 2021] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:53:22.519320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f74abe-e669-474b-b8a8-c0c526c9c024 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:22.532050 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f74abe-e669-474b-b8a8-c0c526c9c024 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:22.614275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff612ade-b0be-4a27-8445-cd30884a95dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:22.615011 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff612ade-b0be-4a27-8445-cd30884a95dc admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:22.615285 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff612ade-b0be-4a27-8445-cd30884a95dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:22.615598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff612ade-b0be-4a27-8445-cd30884a95dc admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:22.616328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff612ade-b0be-4a27-8445-cd30884a95dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:22.618380 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff612ade-b0be-4a27-8445-cd30884a95dc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:22.639110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1269/2540] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:53:22 2021] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:53:22.643243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010b198-7383-4885-ace5-31f1c6ab7c53 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:22.657541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010b198-7383-4885-ace5-31f1c6ab7c53 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:22.662419 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeab50-6ea2-4533-a2de-c372f86648c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:22.663151 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeab50-6ea2-4533-a2de-c372f86648c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:22.663451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeab50-6ea2-4533-a2de-c372f86648c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:22.663721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeab50-6ea2-4533-a2de-c372f86648c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:22.664547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeab50-6ea2-4533-a2de-c372f86648c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:22.666232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeab50-6ea2-4533-a2de-c372f86648c9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:22.677998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1272/2541] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:53:22 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:53:22.682608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff612ade-b0be-4a27-8445-cd30884a95dc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:22.692710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff612ade-b0be-4a27-8445-cd30884a95dc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:22.697688 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232d3ef-cc02-4a95-bbdb-bc9a3fb08842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:22.698598 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d3ef-cc02-4a95-bbdb-bc9a3fb08842 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:22.698874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d3ef-cc02-4a95-bbdb-bc9a3fb08842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:22.699144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d3ef-cc02-4a95-bbdb-bc9a3fb08842 admin admin] PATH_INFO: `/v3/projects/8048e83ece8540b3956c273f439e5688/users/bf9a2635c7914d6ba75243201e08c936/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:22.716381 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232d3ef-cc02-4a95-bbdb-bc9a3fb08842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8048e83ece8540b3956c273f439e5688, user_id=bf9a2635c7914d6ba75243201e08c936, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:22.719137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232d3ef-cc02-4a95-bbdb-bc9a3fb08842 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:22.741642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1270/2542] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:53:22 2021] PUT /identity/v3/projects/8048e83ece8540b3956c273f439e5688/users/bf9a2635c7914d6ba75243201e08c936/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:53:22.746271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeab50-6ea2-4533-a2de-c372f86648c9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:22.756954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeab50-6ea2-4533-a2de-c372f86648c9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:22.819382 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356f49f-e2eb-4cd5-82b7-c5933a772812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:22.820064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356f49f-e2eb-4cd5-82b7-c5933a772812 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:22.820371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356f49f-e2eb-4cd5-82b7-c5933a772812 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:22.820666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356f49f-e2eb-4cd5-82b7-c5933a772812 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:22.821410 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356f49f-e2eb-4cd5-82b7-c5933a772812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:22.823038 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356f49f-e2eb-4cd5-82b7-c5933a772812 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:22.834238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1273/2543] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:53:22 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:53:22.839076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232d3ef-cc02-4a95-bbdb-bc9a3fb08842 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:22.849524 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232d3ef-cc02-4a95-bbdb-bc9a3fb08842 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:22.855407 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89abc-b8a0-4703-8c79-60f06124bf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:22.856321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89abc-b8a0-4703-8c79-60f06124bf4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:22.856630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89abc-b8a0-4703-8c79-60f06124bf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:22.856907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd89abc-b8a0-4703-8c79-60f06124bf4a admin admin] PATH_INFO: `/v3/projects/8048e83ece8540b3956c273f439e5688/users/bf9a2635c7914d6ba75243201e08c936/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:22.858901 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd89abc-b8a0-4703-8c79-60f06124bf4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8048e83ece8540b3956c273f439e5688, user_id=bf9a2635c7914d6ba75243201e08c936, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:22.861776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd89abc-b8a0-4703-8c79-60f06124bf4a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:22.875608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1271/2544] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:53:22 2021] PUT /identity/v3/projects/8048e83ece8540b3956c273f439e5688/users/bf9a2635c7914d6ba75243201e08c936/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:53:27.481004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea07be4-2bb8-4065-a70c-d8d3fbe5b7bb None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:27.481561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea07be4-2bb8-4065-a70c-d8d3fbe5b7bb None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:27.481694 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea07be4-2bb8-4065-a70c-d8d3fbe5b7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:27.512442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9ea07be4-2bb8-4065-a70c-d8d3fbe5b7bb None None] MFA Rules not processed for user `bf9a2635c7914d6ba75243201e08c936`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:53:27.513990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9ea07be4-2bb8-4065-a70c-d8d3fbe5b7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:27.590885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1274/2545] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:53:27 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:53:27.603531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89abc-b8a0-4703-8c79-60f06124bf4a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:27.605753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-dcd89abc-b8a0-4703-8c79-60f06124bf4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:27.688274 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd89abc-b8a0-4703-8c79-60f06124bf4a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:27.693755 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0a0c9-98e4-41bb-a703-6499a484c23c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:27.694508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0a0c9-98e4-41bb-a703-6499a484c23c service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:27.694857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0a0c9-98e4-41bb-a703-6499a484c23c service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:27.695660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0a0c9-98e4-41bb-a703-6499a484c23c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:27.757760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0a0c9-98e4-41bb-a703-6499a484c23c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:27.760205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0a0c9-98e4-41bb-a703-6499a484c23c service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:27.770387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1272/2546] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:53:27 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:53:27.849871 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea07be4-2bb8-4065-a70c-d8d3fbe5b7bb None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:27.851415 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9ea07be4-2bb8-4065-a70c-d8d3fbe5b7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:27.872481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea07be4-2bb8-4065-a70c-d8d3fbe5b7bb None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:27.879044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83479f5e-49f1-453a-ad69-4e4a2092ae02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:27.879810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83479f5e-49f1-453a-ad69-4e4a2092ae02 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:27.880179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83479f5e-49f1-453a-ad69-4e4a2092ae02 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:27.880639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83479f5e-49f1-453a-ad69-4e4a2092ae02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:27.882486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-83479f5e-49f1-453a-ad69-4e4a2092ae02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:27.948090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83479f5e-49f1-453a-ad69-4e4a2092ae02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:27.950389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83479f5e-49f1-453a-ad69-4e4a2092ae02 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:27.962265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1275/2547] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:53:27 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:53:29.050086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa228e-58bf-44c6-814d-0f59d0ca5c1d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:29.050575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa228e-58bf-44c6-814d-0f59d0ca5c1d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:29.050697 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa228e-58bf-44c6-814d-0f59d0ca5c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:29.069346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-fffa228e-58bf-44c6-814d-0f59d0ca5c1d None None] MFA Rules not processed for user `ec44be0e26b44a55910bdccc7c836d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:53:29.070682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fffa228e-58bf-44c6-814d-0f59d0ca5c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:29.080601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1273/2548] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:53:29 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:53:30.904930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83479f5e-49f1-453a-ad69-4e4a2092ae02 service nova] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:30.919677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83479f5e-49f1-453a-ad69-4e4a2092ae02 service nova] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:30.926807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a4bc0-5de5-4c23-9315-1a865933cda9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:30.927479 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a4bc0-5de5-4c23-9315-1a865933cda9 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:30.927767 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a4bc0-5de5-4c23-9315-1a865933cda9 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:30.928051 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a4bc0-5de5-4c23-9315-1a865933cda9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:30.930060 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c68a4bc0-5de5-4c23-9315-1a865933cda9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:30.996966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a4bc0-5de5-4c23-9315-1a865933cda9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:30.998858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a4bc0-5de5-4c23-9315-1a865933cda9 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:31.009040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1276/2549] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:53:30 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:53:45.772974 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa228e-58bf-44c6-814d-0f59d0ca5c1d None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:45.830684 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa228e-58bf-44c6-814d-0f59d0ca5c1d None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:45.834919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022633c-3a90-487e-b7f5-fea4918a6605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:45.835773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022633c-3a90-487e-b7f5-fea4918a6605 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:45.835923 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022633c-3a90-487e-b7f5-fea4918a6605 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:45.836112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022633c-3a90-487e-b7f5-fea4918a6605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:45.839251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a022633c-3a90-487e-b7f5-fea4918a6605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:45.851441 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022633c-3a90-487e-b7f5-fea4918a6605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:45.853140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022633c-3a90-487e-b7f5-fea4918a6605 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:45.862091 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1274/2550] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:53:45 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:53:46.348026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a4bc0-5de5-4c23-9315-1a865933cda9 service nova] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:46.350801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c68a4bc0-5de5-4c23-9315-1a865933cda9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:46.439677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a4bc0-5de5-4c23-9315-1a865933cda9 service nova] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:46.445468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3cc21-c583-4c4f-8e5e-71dbaa7e56ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b7187c26dd41bea9f3c2b49de8ef28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:46.446159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3cc21-c583-4c4f-8e5e-71dbaa7e56ae service placement] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:46.446419 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3cc21-c583-4c4f-8e5e-71dbaa7e56ae service placement] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:46.446743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3cc21-c583-4c4f-8e5e-71dbaa7e56ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:46.448631 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5ab3cc21-c583-4c4f-8e5e-71dbaa7e56ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:46.461330 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3cc21-c583-4c4f-8e5e-71dbaa7e56ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:46.462945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3cc21-c583-4c4f-8e5e-71dbaa7e56ae service placement] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:46.473567 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1277/2551] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:53:46 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:53:47.604827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718d613-29bb-47d2-9db8-be8e1a8a3313 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:47.605423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718d613-29bb-47d2-9db8-be8e1a8a3313 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:47.605423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718d613-29bb-47d2-9db8-be8e1a8a3313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:47.659108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-e718d613-29bb-47d2-9db8-be8e1a8a3313 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:53:47.660453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e718d613-29bb-47d2-9db8-be8e1a8a3313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:47.732730 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1275/2552] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:53:47 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:53:47.786416 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3cc21-c583-4c4f-8e5e-71dbaa7e56ae service placement] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:47.788078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5ab3cc21-c583-4c4f-8e5e-71dbaa7e56ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:47.884384 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3cc21-c583-4c4f-8e5e-71dbaa7e56ae service placement] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:47.888659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2bc81-a5aa-4688-8ff5-a623bc6642f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:47.889315 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2bc81-a5aa-4688-8ff5-a623bc6642f4 service swift] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:47.889603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2bc81-a5aa-4688-8ff5-a623bc6642f4 service swift] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:47.889866 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2bc81-a5aa-4688-8ff5-a623bc6642f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:47.898787 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2bc81-a5aa-4688-8ff5-a623bc6642f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:47.900400 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2bc81-a5aa-4688-8ff5-a623bc6642f4 service swift] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:47.909203 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1278/2553] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:53:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:53:48.685135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718d613-29bb-47d2-9db8-be8e1a8a3313 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:48.701612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718d613-29bb-47d2-9db8-be8e1a8a3313 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:48.717241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c7e4e-a19a-44b6-9b1e-30813593b3d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:48.718359 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7e4e-a19a-44b6-9b1e-30813593b3d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:48.718868 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7e4e-a19a-44b6-9b1e-30813593b3d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:48.719338 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c7e4e-a19a-44b6-9b1e-30813593b3d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:48.725997 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-379c7e4e-a19a-44b6-9b1e-30813593b3d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:48.759371 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c7e4e-a19a-44b6-9b1e-30813593b3d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:48.761350 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c7e4e-a19a-44b6-9b1e-30813593b3d9 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:48.781134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1276/2554] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:53:48 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:53:49.685649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2bc81-a5aa-4688-8ff5-a623bc6642f4 service swift] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:53:49.725680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2bc81-a5aa-4688-8ff5-a623bc6642f4 service swift] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:53:49.744511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346af4f5-734f-4aee-b7c5-2ea2603bcf72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:53:49.745252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346af4f5-734f-4aee-b7c5-2ea2603bcf72 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:53:49.745541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346af4f5-734f-4aee-b7c5-2ea2603bcf72 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:53:49.745816 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346af4f5-734f-4aee-b7c5-2ea2603bcf72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:53:49.756388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-346af4f5-734f-4aee-b7c5-2ea2603bcf72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:53:49.796353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346af4f5-734f-4aee-b7c5-2ea2603bcf72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:53:49.799427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346af4f5-734f-4aee-b7c5-2ea2603bcf72 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:53:49.818177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1279/2555] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:53:49 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:54:00.530288 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c7e4e-a19a-44b6-9b1e-30813593b3d9 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:00.545562 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c7e4e-a19a-44b6-9b1e-30813593b3d9 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:00.553732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf19fb-a4e8-4f31-ab6c-1d2df31fa27b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:00.555223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf19fb-a4e8-4f31-ab6c-1d2df31fa27b service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:00.555517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf19fb-a4e8-4f31-ab6c-1d2df31fa27b service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:00.555795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf19fb-a4e8-4f31-ab6c-1d2df31fa27b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:00.557800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d9cf19fb-a4e8-4f31-ab6c-1d2df31fa27b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:00.570852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf19fb-a4e8-4f31-ab6c-1d2df31fa27b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:00.572492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf19fb-a4e8-4f31-ab6c-1d2df31fa27b service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:00.583601 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1277/2556] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:54:00 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:54:02.713631 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346af4f5-734f-4aee-b7c5-2ea2603bcf72 service nova] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:02.715086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-346af4f5-734f-4aee-b7c5-2ea2603bcf72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:02.726528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346af4f5-734f-4aee-b7c5-2ea2603bcf72 service nova] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:02.730567 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798aad4e-e394-4948-8bd2-3210564663a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:02.731271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aad4e-e394-4948-8bd2-3210564663a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:02.731560 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aad4e-e394-4948-8bd2-3210564663a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:02.731898 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aad4e-e394-4948-8bd2-3210564663a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:02.745197 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798aad4e-e394-4948-8bd2-3210564663a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:02.746669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798aad4e-e394-4948-8bd2-3210564663a1 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:02.770252 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1280/2557] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:54:02 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:54:03.508470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad98e3-61b3-4d79-833d-f6ea316aec95 None None] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:03.509323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad98e3-61b3-4d79-833d-f6ea316aec95 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:03.509876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad98e3-61b3-4d79-833d-f6ea316aec95 None None] PATH_INFO: `/` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:03.513136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1278/2558] 10.222.0.62 () {54 vars in 921 bytes} [Mon Dec 13 16:54:03 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:54:03.521150 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3fde5-8313-4020-a5b2-3383fbc40b1c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:03.521603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3fde5-8313-4020-a5b2-3383fbc40b1c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:03.522033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3fde5-8313-4020-a5b2-3383fbc40b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:03.563756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-dec3fde5-8313-4020-a5b2-3383fbc40b1c None None] MFA Rules not processed for user `dfecc747eb8d431a8d57f4534d259de8`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:54:03.565081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-dec3fde5-8313-4020-a5b2-3383fbc40b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:03.576961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1281/2559] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Dec 13 16:54:03 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:54:03.592176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad98e3-61b3-4d79-833d-f6ea316aec95 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:03.593988 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-61ad98e3-61b3-4d79-833d-f6ea316aec95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:03.673406 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad98e3-61b3-4d79-833d-f6ea316aec95 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:03.679008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ce90d-b48b-42a0-b20a-f58228c5969a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18f1422ce48e44ab85e6d5e10d1ea898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:03.679008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ce90d-b48b-42a0-b20a-f58228c5969a service glance] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:03.679362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ce90d-b48b-42a0-b20a-f58228c5969a service glance] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:03.679546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ce90d-b48b-42a0-b20a-f58228c5969a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:03.691616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ce90d-b48b-42a0-b20a-f58228c5969a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:03.693299 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ce90d-b48b-42a0-b20a-f58228c5969a service glance] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:03.707719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1279/2560] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:54:03 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:54:03.794057 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9945380-70ef-42eb-b32c-636c6ec8eebc None None] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:03.794765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9945380-70ef-42eb-b32c-636c6ec8eebc None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:03.796863 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9945380-70ef-42eb-b32c-636c6ec8eebc None None] PATH_INFO: `/` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:03.799811 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1282/2561] 10.222.0.62 () {54 vars in 921 bytes} [Mon Dec 13 16:54:03 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Dec 13 16:54:03.809260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0def498-e57b-467d-83b3-0752461d4e3e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:03.809689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0def498-e57b-467d-83b3-0752461d4e3e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:03.810043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0def498-e57b-467d-83b3-0752461d4e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:03.832938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-c0def498-e57b-467d-83b3-0752461d4e3e None None] MFA Rules not processed for user `51f9a10e3d87475e92fb49686f1aa456`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:54:03.834136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c0def498-e57b-467d-83b3-0752461d4e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:03.841038 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1280/2562] 10.222.0.62 () {58 vars in 1018 bytes} [Mon Dec 13 16:54:03 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:54:03.854633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9945380-70ef-42eb-b32c-636c6ec8eebc None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:03.882042 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9945380-70ef-42eb-b32c-636c6ec8eebc None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:03.887257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889d9cdd-4f39-4ff3-8158-0a82ee16302d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:03.888060 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d9cdd-4f39-4ff3-8158-0a82ee16302d service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:03.888513 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d9cdd-4f39-4ff3-8158-0a82ee16302d service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:03.888926 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889d9cdd-4f39-4ff3-8158-0a82ee16302d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:03.896970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d9cdd-4f39-4ff3-8158-0a82ee16302d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:03.898422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889d9cdd-4f39-4ff3-8158-0a82ee16302d service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:03.906821 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1283/2563] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:54:03 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:54:04.615690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0def498-e57b-467d-83b3-0752461d4e3e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:04.630317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0def498-e57b-467d-83b3-0752461d4e3e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:04.638638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158dde7-b89b-4473-a3f2-1f91b6e3983c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:04.639306 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158dde7-b89b-4473-a3f2-1f91b6e3983c service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:04.639587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158dde7-b89b-4473-a3f2-1f91b6e3983c service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:04.639861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158dde7-b89b-4473-a3f2-1f91b6e3983c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:04.641985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f158dde7-b89b-4473-a3f2-1f91b6e3983c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:04.656155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158dde7-b89b-4473-a3f2-1f91b6e3983c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:04.657937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158dde7-b89b-4473-a3f2-1f91b6e3983c service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:04.673677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1281/2564] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:54:04 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:54:05.942926 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90942854-ddad-4ec8-bcac-3bb6782178d5 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:05.943448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90942854-ddad-4ec8-bcac-3bb6782178d5 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:05.943448 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90942854-ddad-4ec8-bcac-3bb6782178d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:05.964182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-90942854-ddad-4ec8-bcac-3bb6782178d5 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:54:05.965441 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-90942854-ddad-4ec8-bcac-3bb6782178d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:05.973755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1284/2565] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:54:05 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:54:05.988603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158dde7-b89b-4473-a3f2-1f91b6e3983c service nova] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:06.000850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158dde7-b89b-4473-a3f2-1f91b6e3983c service nova] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:06.006150 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb3e95-f554-43bd-90f9-431ea8f697f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:06.006938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb3e95-f554-43bd-90f9-431ea8f697f3 service swift] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:06.007294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb3e95-f554-43bd-90f9-431ea8f697f3 service swift] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:06.007630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb3e95-f554-43bd-90f9-431ea8f697f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:06.015894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb3e95-f554-43bd-90f9-431ea8f697f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:06.017563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb3e95-f554-43bd-90f9-431ea8f697f3 service swift] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:06.026255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1282/2566] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:54:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:54:22.008192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c630f-26cd-4db4-bd87-e5adc23e2b2d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:22.008722 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c630f-26cd-4db4-bd87-e5adc23e2b2d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:22.009008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c630f-26cd-4db4-bd87-e5adc23e2b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:22.029084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-6e4c630f-26cd-4db4-bd87-e5adc23e2b2d None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:54:22.030291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6e4c630f-26cd-4db4-bd87-e5adc23e2b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:22.039940 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1285/2567] 10.222.0.62 () {58 vars in 967 bytes} [Mon Dec 13 16:54:22 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:54:22.056010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb3e95-f554-43bd-90f9-431ea8f697f3 service swift] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:22.067174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb3e95-f554-43bd-90f9-431ea8f697f3 service swift] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:22.072389 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782ff76-72e3-4a20-bde8-9acf7939289e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:22.073264 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782ff76-72e3-4a20-bde8-9acf7939289e service swift] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:22.073639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782ff76-72e3-4a20-bde8-9acf7939289e service swift] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:22.073917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782ff76-72e3-4a20-bde8-9acf7939289e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:22.083040 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782ff76-72e3-4a20-bde8-9acf7939289e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:22.084112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0782ff76-72e3-4a20-bde8-9acf7939289e service swift] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:22.092872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1283/2568] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:54:22 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:54:35.644217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c630f-26cd-4db4-bd87-e5adc23e2b2d None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:35.661788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c630f-26cd-4db4-bd87-e5adc23e2b2d None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:35.666021 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411d99b-1818-423e-b6ea-453574e95b2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:35.667172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d99b-1818-423e-b6ea-453574e95b2b service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:35.667650 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d99b-1818-423e-b6ea-453574e95b2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:35.667930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d99b-1818-423e-b6ea-453574e95b2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:35.669890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b411d99b-1818-423e-b6ea-453574e95b2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:35.747336 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411d99b-1818-423e-b6ea-453574e95b2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:35.749198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411d99b-1818-423e-b6ea-453574e95b2b service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:35.763044 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1286/2569] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:54:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:54:39.266234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782ff76-72e3-4a20-bde8-9acf7939289e service swift] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:39.269784 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0782ff76-72e3-4a20-bde8-9acf7939289e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:39.286097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782ff76-72e3-4a20-bde8-9acf7939289e service swift] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:39.291658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e1398-265a-4c4b-8690-c65dc904ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:39.292549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e1398-265a-4c4b-8690-c65dc904ea29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:39.292859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e1398-265a-4c4b-8690-c65dc904ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:39.293133 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e1398-265a-4c4b-8690-c65dc904ea29 admin admin] PATH_INFO: `/v3/users/c282fd140f5645ca89c2e64888ea1345` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:39.294403 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e1398-265a-4c4b-8690-c65dc904ea29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c282fd140f5645ca89c2e64888ea1345)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:39.296384 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e1398-265a-4c4b-8690-c65dc904ea29 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:39.355131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d25e1398-265a-4c4b-8690-c65dc904ea29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c282fd140f5645ca89c2e64888ea1345'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:54:39.367057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d25e1398-265a-4c4b-8690-c65dc904ea29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c282fd140f5645ca89c2e64888ea1345'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:54:39.375479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d25e1398-265a-4c4b-8690-c65dc904ea29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c282fd140f5645ca89c2e64888ea1345'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:54:39.383484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d25e1398-265a-4c4b-8690-c65dc904ea29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c282fd140f5645ca89c2e64888ea1345'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:54:39.384170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-d25e1398-265a-4c4b-8690-c65dc904ea29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c282fd140f5645ca89c2e64888ea1345'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:54:39.389891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1284/2570] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:54:39 2021] DELETE /identity/v3/users/c282fd140f5645ca89c2e64888ea1345 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:54:39.570577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411d99b-1818-423e-b6ea-453574e95b2b service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:39.582890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411d99b-1818-423e-b6ea-453574e95b2b service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:39.641679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:39.642620 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:39.642911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:39.643211 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] PATH_INFO: `/v3/projects/febd1024088a4a22984d59922da28de1` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:39.645053 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=febd1024088a4a22984d59922da28de1)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:39.647024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:39.695883 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'febd1024088a4a22984d59922da28de1', 'request_id': 'req-bd9894b7-7c3b-4584-ae75-36683652bf22'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:54:39.706038 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'febd1024088a4a22984d59922da28de1', 'request_id': 'req-bd9894b7-7c3b-4584-ae75-36683652bf22'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:54:39.712887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'febd1024088a4a22984d59922da28de1', 'request_id': 'req-bd9894b7-7c3b-4584-ae75-36683652bf22'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:54:39.725468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] The token cache is being invalidate because project febd1024088a4a22984d59922da28de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:54:39.725747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:54:39.726425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-bd9894b7-7c3b-4584-ae75-36683652bf22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:54:39.727957 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1287/2571] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:54:39 2021] DELETE /identity/v3/projects/febd1024088a4a22984d59922da28de1 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:54:39.736905 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e164-de2b-4056-9466-f9335b97ff3b None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:39.737255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e164-de2b-4056-9466-f9335b97ff3b None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:39.737836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6e164-de2b-4056-9466-f9335b97ff3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:39.757207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7ad6e164-de2b-4056-9466-f9335b97ff3b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:54:39.758486 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7ad6e164-de2b-4056-9466-f9335b97ff3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:39.832960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1285/2572] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:54:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:54:39.841470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a1712-292b-4a60-8656-7a7baba8c53e None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:39.841740 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a1712-292b-4a60-8656-7a7baba8c53e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:39.842007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a1712-292b-4a60-8656-7a7baba8c53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:39.861815 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-f62a1712-292b-4a60-8656-7a7baba8c53e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:54:39.863178 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f62a1712-292b-4a60-8656-7a7baba8c53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:39.871404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1288/2573] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:54:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:54:39.875891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e164-de2b-4056-9466-f9335b97ff3b None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:39.886296 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6e164-de2b-4056-9466-f9335b97ff3b None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:39.892210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8f66-8f1c-4505-abe1-96eb65b0b6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:39.893312 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8f66-8f1c-4505-abe1-96eb65b0b6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:39.893610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8f66-8f1c-4505-abe1-96eb65b0b6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:39.894045 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb8f66-8f1c-4505-abe1-96eb65b0b6f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:39.894578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8f66-8f1c-4505-abe1-96eb65b0b6f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:54:39.894876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8f66-8f1c-4505-abe1-96eb65b0b6f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:39.896482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb8f66-8f1c-4505-abe1-96eb65b0b6f5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:39.909929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1286/2574] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:54:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:54:39.914648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a1712-292b-4a60-8656-7a7baba8c53e None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:39.924206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a1712-292b-4a60-8656-7a7baba8c53e None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:39.930904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34334c65-d2e0-41cb-a702-74948fa52c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:39.931557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34334c65-d2e0-41cb-a702-74948fa52c19 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:39.931831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34334c65-d2e0-41cb-a702-74948fa52c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:39.932101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34334c65-d2e0-41cb-a702-74948fa52c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:39.932834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34334c65-d2e0-41cb-a702-74948fa52c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:39.934736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34334c65-d2e0-41cb-a702-74948fa52c19 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:39.973684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1289/2575] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:54:39 2021] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:54:39.978271 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8f66-8f1c-4505-abe1-96eb65b0b6f5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:39.989218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb8f66-8f1c-4505-abe1-96eb65b0b6f5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:40.048298 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4ffd4-4b4c-4966-975c-b076a71dc95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:40.049149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4ffd4-4b4c-4966-975c-b076a71dc95a admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:40.049431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4ffd4-4b4c-4966-975c-b076a71dc95a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:40.049708 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4ffd4-4b4c-4966-975c-b076a71dc95a admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:40.050417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4ffd4-4b4c-4966-975c-b076a71dc95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:40.052338 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4ffd4-4b4c-4966-975c-b076a71dc95a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:40.079062 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1287/2576] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:54:39 2021] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:54:40.086121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34334c65-d2e0-41cb-a702-74948fa52c19 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:40.100652 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34334c65-d2e0-41cb-a702-74948fa52c19 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:40.106679 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603afaf2-e044-446b-b663-506290b84ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:40.107346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603afaf2-e044-446b-b663-506290b84ded admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:40.107633 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603afaf2-e044-446b-b663-506290b84ded admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:40.107899 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603afaf2-e044-446b-b663-506290b84ded admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:40.108671 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603afaf2-e044-446b-b663-506290b84ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:40.110621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603afaf2-e044-446b-b663-506290b84ded admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:40.122116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1290/2577] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:54:40 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:54:40.126919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4ffd4-4b4c-4966-975c-b076a71dc95a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:40.137818 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4ffd4-4b4c-4966-975c-b076a71dc95a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:40.142682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e958b9-412c-4c19-94dc-0dadd6e550a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:40.143349 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e958b9-412c-4c19-94dc-0dadd6e550a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:40.143635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e958b9-412c-4c19-94dc-0dadd6e550a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:40.143907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e958b9-412c-4c19-94dc-0dadd6e550a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:40.144779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e958b9-412c-4c19-94dc-0dadd6e550a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:40.146323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e958b9-412c-4c19-94dc-0dadd6e550a4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:40.157472 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1288/2578] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:54:40 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:54:40.163770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603afaf2-e044-446b-b663-506290b84ded admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:40.180059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603afaf2-e044-446b-b663-506290b84ded admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:40.187919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d1738-cdc4-46d5-836b-c3fd6232a617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:40.189250 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d1738-cdc4-46d5-836b-c3fd6232a617 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:40.189808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d1738-cdc4-46d5-836b-c3fd6232a617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:40.190172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d1738-cdc4-46d5-836b-c3fd6232a617 admin admin] PATH_INFO: `/v3/projects/c6d1af29ea9c44a7870cae601abfe353/users/431688bdedc6443cb3718b6af3cdcc30/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:40.211365 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d1738-cdc4-46d5-836b-c3fd6232a617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d1af29ea9c44a7870cae601abfe353, user_id=431688bdedc6443cb3718b6af3cdcc30, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:40.214099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d1738-cdc4-46d5-836b-c3fd6232a617 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:40.235825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1291/2579] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:54:40 2021] PUT /identity/v3/projects/c6d1af29ea9c44a7870cae601abfe353/users/431688bdedc6443cb3718b6af3cdcc30/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:54:40.241284 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970792e-230b-4c0e-8061-77ba436f1605 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:40.241599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970792e-230b-4c0e-8061-77ba436f1605 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:40.241876 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970792e-230b-4c0e-8061-77ba436f1605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:40.261261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-0970792e-230b-4c0e-8061-77ba436f1605 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:54:40.262446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0970792e-230b-4c0e-8061-77ba436f1605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:40.332696 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1289/2580] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:54:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:54:40.342834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d1738-cdc4-46d5-836b-c3fd6232a617 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:40.344746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d15d1738-cdc4-46d5-836b-c3fd6232a617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:40.407546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d1738-cdc4-46d5-836b-c3fd6232a617 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:40.413916 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08646817-ca3e-4f62-8f87-df1a0ceba39a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:40.414570 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08646817-ca3e-4f62-8f87-df1a0ceba39a service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:40.414852 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08646817-ca3e-4f62-8f87-df1a0ceba39a service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:40.415121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08646817-ca3e-4f62-8f87-df1a0ceba39a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:40.425919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08646817-ca3e-4f62-8f87-df1a0ceba39a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:40.427402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08646817-ca3e-4f62-8f87-df1a0ceba39a service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:40.437185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1292/2581] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:54:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:54:41.326687 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332753e-2a57-4a05-a2f5-531504da56b7 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:41.327189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332753e-2a57-4a05-a2f5-531504da56b7 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:41.327687 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332753e-2a57-4a05-a2f5-531504da56b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:41.373108 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f332753e-2a57-4a05-a2f5-531504da56b7 None None] MFA Rules not processed for user `431688bdedc6443cb3718b6af3cdcc30`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:54:41.374971 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f332753e-2a57-4a05-a2f5-531504da56b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:41.443964 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1290/2582] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:54:41 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:54:41.456729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7c165-b20c-4e36-85de-0336f130f8c3 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:41.457329 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7c165-b20c-4e36-85de-0336f130f8c3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:41.457329 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7c165-b20c-4e36-85de-0336f130f8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:41.475474 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c7b7c165-b20c-4e36-85de-0336f130f8c3 None None] MFA Rules not processed for user `431688bdedc6443cb3718b6af3cdcc30`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:54:41.476695 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c7b7c165-b20c-4e36-85de-0336f130f8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:41.484680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1293/2583] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:54:41 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:54:41.497092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332753e-2a57-4a05-a2f5-531504da56b7 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:54:41.498863 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f332753e-2a57-4a05-a2f5-531504da56b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:41.577442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332753e-2a57-4a05-a2f5-531504da56b7 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:54:41.584188 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5bbec-9af7-4964-974a-7585462d6727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:54:41.584881 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5bbec-9af7-4964-974a-7585462d6727 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:41.585162 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5bbec-9af7-4964-974a-7585462d6727 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:41.585430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5bbec-9af7-4964-974a-7585462d6727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:41.593908 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5bbec-9af7-4964-974a-7585462d6727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:54:41.595559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5bbec-9af7-4964-974a-7585462d6727 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:54:41.605206 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1291/2584] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:54:41 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:54:58.609724 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6fabb-b39b-4c45-b984-c33abbd4d598 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:54:58.610367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6fabb-b39b-4c45-b984-c33abbd4d598 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:54:58.610367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6fabb-b39b-4c45-b984-c33abbd4d598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:54:58.628779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-4ee6fabb-b39b-4c45-b984-c33abbd4d598 None None] MFA Rules not processed for user `431688bdedc6443cb3718b6af3cdcc30`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:54:58.630086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4ee6fabb-b39b-4c45-b984-c33abbd4d598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:54:58.637344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1294/2585] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:54:58 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:03.432230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5bbec-9af7-4964-974a-7585462d6727 service nova] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:03.433926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-16b5bbec-9af7-4964-974a-7585462d6727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:03.447300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5bbec-9af7-4964-974a-7585462d6727 service nova] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:03.451377 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98218255-98be-4435-93d2-92c0a23660de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:03.452018 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98218255-98be-4435-93d2-92c0a23660de service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:03.452302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98218255-98be-4435-93d2-92c0a23660de service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:03.452599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98218255-98be-4435-93d2-92c0a23660de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:03.454446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-98218255-98be-4435-93d2-92c0a23660de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:03.466836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98218255-98be-4435-93d2-92c0a23660de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:03.468275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98218255-98be-4435-93d2-92c0a23660de service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:03.478297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1292/2586] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:03 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:55:07.399589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6fabb-b39b-4c45-b984-c33abbd4d598 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:07.401136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-4ee6fabb-b39b-4c45-b984-c33abbd4d598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:07.421298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6fabb-b39b-4c45-b984-c33abbd4d598 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:07.426599 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30607c8c-aabb-4ab1-9749-36d0c88ca004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:07.427486 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30607c8c-aabb-4ab1-9749-36d0c88ca004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:07.427786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30607c8c-aabb-4ab1-9749-36d0c88ca004 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:07.428035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30607c8c-aabb-4ab1-9749-36d0c88ca004 admin admin] PATH_INFO: `/v3/users/e9c2500682e64b3a91e811a3ba09bd20` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:07.429708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30607c8c-aabb-4ab1-9749-36d0c88ca004 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c2500682e64b3a91e811a3ba09bd20)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:07.432117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30607c8c-aabb-4ab1-9749-36d0c88ca004 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:07.485828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-30607c8c-aabb-4ab1-9749-36d0c88ca004 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c2500682e64b3a91e811a3ba09bd20'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:07.498702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-30607c8c-aabb-4ab1-9749-36d0c88ca004 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c2500682e64b3a91e811a3ba09bd20'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:07.499353 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-30607c8c-aabb-4ab1-9749-36d0c88ca004 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c2500682e64b3a91e811a3ba09bd20'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:07.506348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-30607c8c-aabb-4ab1-9749-36d0c88ca004 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c2500682e64b3a91e811a3ba09bd20'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:07.516325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-30607c8c-aabb-4ab1-9749-36d0c88ca004 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c2500682e64b3a91e811a3ba09bd20'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:07.523275 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1295/2587] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:55:07 2021] DELETE /identity/v3/users/e9c2500682e64b3a91e811a3ba09bd20 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:07.720444 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98218255-98be-4435-93d2-92c0a23660de service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:07.731720 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98218255-98be-4435-93d2-92c0a23660de service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:07.791255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:07.792120 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:07.792400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:07.792704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] PATH_INFO: `/v3/projects/c94e8e265a6f4fb585504a1e95ceda28` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:07.793888 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c94e8e265a6f4fb585504a1e95ceda28)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:07.795793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:07.849504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c94e8e265a6f4fb585504a1e95ceda28', 'request_id': 'req-b129acf3-2b00-4489-9b9f-84635144416a'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:07.860392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c94e8e265a6f4fb585504a1e95ceda28', 'request_id': 'req-b129acf3-2b00-4489-9b9f-84635144416a'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:07.867122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c94e8e265a6f4fb585504a1e95ceda28', 'request_id': 'req-b129acf3-2b00-4489-9b9f-84635144416a'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:07.877713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] The token cache is being invalidate because project c94e8e265a6f4fb585504a1e95ceda28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:55:07.877999 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:07.878650 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b129acf3-2b00-4489-9b9f-84635144416a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:07.880367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1293/2588] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:55:07 2021] DELETE /identity/v3/projects/c94e8e265a6f4fb585504a1e95ceda28 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:07.888452 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5102-4c11-4285-9f38-4e5851e5342b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:07.888780 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5102-4c11-4285-9f38-4e5851e5342b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:07.889062 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5102-4c11-4285-9f38-4e5851e5342b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:07.908387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-f72c5102-4c11-4285-9f38-4e5851e5342b None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:07.909627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f72c5102-4c11-4285-9f38-4e5851e5342b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:07.976390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1296/2589] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:07.986516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd54a74-685c-4ea5-8caf-4a1474a8914d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:07.986824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd54a74-685c-4ea5-8caf-4a1474a8914d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:07.987094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd54a74-685c-4ea5-8caf-4a1474a8914d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.007986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-1fd54a74-685c-4ea5-8caf-4a1474a8914d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:08.009231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1fd54a74-685c-4ea5-8caf-4a1474a8914d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:08.018129 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1294/2590] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:08.024862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c5102-4c11-4285-9f38-4e5851e5342b None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.034534 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c5102-4c11-4285-9f38-4e5851e5342b None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.039663 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f02f-bc3c-4d16-b2d7-6e7c40efe284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.040314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f02f-bc3c-4d16-b2d7-6e7c40efe284 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.040608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f02f-bc3c-4d16-b2d7-6e7c40efe284 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.040880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f02f-bc3c-4d16-b2d7-6e7c40efe284 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.041640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f02f-bc3c-4d16-b2d7-6e7c40efe284 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:55:08.041939 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f02f-bc3c-4d16-b2d7-6e7c40efe284 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.043540 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f02f-bc3c-4d16-b2d7-6e7c40efe284 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.055979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1297/2591] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:55:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:55:08.060377 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd54a74-685c-4ea5-8caf-4a1474a8914d None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.070550 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd54a74-685c-4ea5-8caf-4a1474a8914d None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.076064 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6998327-a837-4478-ae26-024937578e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.076774 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6998327-a837-4478-ae26-024937578e19 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.077056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6998327-a837-4478-ae26-024937578e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.077325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6998327-a837-4478-ae26-024937578e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.078028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6998327-a837-4478-ae26-024937578e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.079949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6998327-a837-4478-ae26-024937578e19 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.120121 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1295/2592] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:55:08 2021] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:55:08.121451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f02f-bc3c-4d16-b2d7-6e7c40efe284 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.131143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f02f-bc3c-4d16-b2d7-6e7c40efe284 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.196160 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85201f-1540-4a66-b444-470282f32358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.196859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85201f-1540-4a66-b444-470282f32358 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.197132 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85201f-1540-4a66-b444-470282f32358 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.197404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85201f-1540-4a66-b444-470282f32358 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.198106 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85201f-1540-4a66-b444-470282f32358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.199988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85201f-1540-4a66-b444-470282f32358 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.225526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1298/2593] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:55:08 2021] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:55:08.230322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6998327-a837-4478-ae26-024937578e19 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.241122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6998327-a837-4478-ae26-024937578e19 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.251854 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177148d-a7bc-42fd-9c14-6aeda07f6abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.252803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177148d-a7bc-42fd-9c14-6aeda07f6abd admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.253061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177148d-a7bc-42fd-9c14-6aeda07f6abd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.253342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177148d-a7bc-42fd-9c14-6aeda07f6abd admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.254204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177148d-a7bc-42fd-9c14-6aeda07f6abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.255996 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177148d-a7bc-42fd-9c14-6aeda07f6abd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.268211 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1296/2594] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:08 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:08.272673 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85201f-1540-4a66-b444-470282f32358 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.283084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85201f-1540-4a66-b444-470282f32358 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.288099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b425bad-d47b-4f49-ac30-d0e0065cd4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.288828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b425bad-d47b-4f49-ac30-d0e0065cd4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.289111 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b425bad-d47b-4f49-ac30-d0e0065cd4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.289391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b425bad-d47b-4f49-ac30-d0e0065cd4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.290128 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b425bad-d47b-4f49-ac30-d0e0065cd4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.291734 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b425bad-d47b-4f49-ac30-d0e0065cd4b4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.302039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1299/2595] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:08.306894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177148d-a7bc-42fd-9c14-6aeda07f6abd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.317212 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177148d-a7bc-42fd-9c14-6aeda07f6abd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.322654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db8e8f-4440-4f62-a9f4-c4656af0b9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.323576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db8e8f-4440-4f62-a9f4-c4656af0b9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.323891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db8e8f-4440-4f62-a9f4-c4656af0b9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.324166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db8e8f-4440-4f62-a9f4-c4656af0b9b5 admin admin] PATH_INFO: `/v3/projects/a01706757bdd4ac6a7e9d76556b4b26a/users/38a6c581c9f3435c9c76887c36fa74ee/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.343349 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db8e8f-4440-4f62-a9f4-c4656af0b9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01706757bdd4ac6a7e9d76556b4b26a, user_id=38a6c581c9f3435c9c76887c36fa74ee, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.346287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db8e8f-4440-4f62-a9f4-c4656af0b9b5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.367263 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1297/2596] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:55:08 2021] PUT /identity/v3/projects/a01706757bdd4ac6a7e9d76556b4b26a/users/38a6c581c9f3435c9c76887c36fa74ee/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:08.378225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43701885-f0a3-4efd-9e0c-978cebe346e7 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.378518 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43701885-f0a3-4efd-9e0c-978cebe346e7 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.378798 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43701885-f0a3-4efd-9e0c-978cebe346e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.407661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-43701885-f0a3-4efd-9e0c-978cebe346e7 None None] MFA Rules not processed for user `38a6c581c9f3435c9c76887c36fa74ee`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:08.408907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-43701885-f0a3-4efd-9e0c-978cebe346e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:08.477038 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1300/2597] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:08 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:08.481603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db8e8f-4440-4f62-a9f4-c4656af0b9b5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.551215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db8e8f-4440-4f62-a9f4-c4656af0b9b5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.558484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f9957-f4e5-4c3e-9bce-ba2c7ad2a161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.559149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f9957-f4e5-4c3e-9bce-ba2c7ad2a161 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.559431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f9957-f4e5-4c3e-9bce-ba2c7ad2a161 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.559690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f9957-f4e5-4c3e-9bce-ba2c7ad2a161 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.560671 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f9957-f4e5-4c3e-9bce-ba2c7ad2a161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.562616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f9957-f4e5-4c3e-9bce-ba2c7ad2a161 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.592592 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1298/2598] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:55:08 2021] POST /identity/v3/projects => generated 393 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:55:08.596827 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43701885-f0a3-4efd-9e0c-978cebe346e7 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.607742 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43701885-f0a3-4efd-9e0c-978cebe346e7 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.667101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbde65-a20f-4663-b101-fde53d02ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.667671 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbde65-a20f-4663-b101-fde53d02ceb4 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.667952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbde65-a20f-4663-b101-fde53d02ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.668216 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbde65-a20f-4663-b101-fde53d02ceb4 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.668982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbde65-a20f-4663-b101-fde53d02ceb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.670936 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbde65-a20f-4663-b101-fde53d02ceb4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.695632 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1301/2599] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:55:08 2021] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:55:08.699807 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f9957-f4e5-4c3e-9bce-ba2c7ad2a161 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.710808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f9957-f4e5-4c3e-9bce-ba2c7ad2a161 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.716706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa2a97-d635-4317-8cd0-255011eba854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.717375 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa2a97-d635-4317-8cd0-255011eba854 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.717660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa2a97-d635-4317-8cd0-255011eba854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.717935 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa2a97-d635-4317-8cd0-255011eba854 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.718690 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa2a97-d635-4317-8cd0-255011eba854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.720301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa2a97-d635-4317-8cd0-255011eba854 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.733309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1299/2600] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:08 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:08.737657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbde65-a20f-4663-b101-fde53d02ceb4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.748324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbde65-a20f-4663-b101-fde53d02ceb4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.753836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd46c1-1a0a-4926-8825-b85af5cf8a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.754741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd46c1-1a0a-4926-8825-b85af5cf8a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.755015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd46c1-1a0a-4926-8825-b85af5cf8a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.755285 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd46c1-1a0a-4926-8825-b85af5cf8a47 admin admin] PATH_INFO: `/v3/projects/dce58a46423e4980ac8a411a65c40fec/users/0d8301a57f7a499090ba400864d1b6c5/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.770852 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd46c1-1a0a-4926-8825-b85af5cf8a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce58a46423e4980ac8a411a65c40fec, user_id=0d8301a57f7a499090ba400864d1b6c5, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.773890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd46c1-1a0a-4926-8825-b85af5cf8a47 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.789075 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1302/2601] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:55:08 2021] PUT /identity/v3/projects/dce58a46423e4980ac8a411a65c40fec/users/0d8301a57f7a499090ba400864d1b6c5/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:08.793212 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa2a97-d635-4317-8cd0-255011eba854 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.803302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa2a97-d635-4317-8cd0-255011eba854 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.861889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a903dc-e5c8-48b0-999c-04bab264a806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.862587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a903dc-e5c8-48b0-999c-04bab264a806 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.862788 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a903dc-e5c8-48b0-999c-04bab264a806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.863100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a903dc-e5c8-48b0-999c-04bab264a806 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.863823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a903dc-e5c8-48b0-999c-04bab264a806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.865453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a903dc-e5c8-48b0-999c-04bab264a806 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.875240 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1300/2602] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:08 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:08.879590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd46c1-1a0a-4926-8825-b85af5cf8a47 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:08.890040 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd46c1-1a0a-4926-8825-b85af5cf8a47 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:08.894943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b83785-2db1-441a-91e4-af39a0d32fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:08.895836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b83785-2db1-441a-91e4-af39a0d32fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.896144 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b83785-2db1-441a-91e4-af39a0d32fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.896395 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b83785-2db1-441a-91e4-af39a0d32fa3 admin admin] PATH_INFO: `/v3/projects/dce58a46423e4980ac8a411a65c40fec/users/0d8301a57f7a499090ba400864d1b6c5/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.900035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b83785-2db1-441a-91e4-af39a0d32fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dce58a46423e4980ac8a411a65c40fec, user_id=0d8301a57f7a499090ba400864d1b6c5, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:08.902709 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b83785-2db1-441a-91e4-af39a0d32fa3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:08.913315 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1303/2603] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:55:08 2021] PUT /identity/v3/projects/dce58a46423e4980ac8a411a65c40fec/users/0d8301a57f7a499090ba400864d1b6c5/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:55:08.924034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce6a76-6f35-488d-8bd9-ddca74596714 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:08.924210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce6a76-6f35-488d-8bd9-ddca74596714 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:08.924474 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce6a76-6f35-488d-8bd9-ddca74596714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:08.952402 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-54ce6a76-6f35-488d-8bd9-ddca74596714 None None] MFA Rules not processed for user `0d8301a57f7a499090ba400864d1b6c5`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:08.953648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-54ce6a76-6f35-488d-8bd9-ddca74596714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:09.021555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1301/2604] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:08 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:09.038775 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b83785-2db1-441a-91e4-af39a0d32fa3 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:09.041466 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-64b83785-2db1-441a-91e4-af39a0d32fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:09.112269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b83785-2db1-441a-91e4-af39a0d32fa3 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:09.117664 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b271be2a-c168-41f7-a8a5-a2468cf047a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:09.118348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271be2a-c168-41f7-a8a5-a2468cf047a3 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:09.118675 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271be2a-c168-41f7-a8a5-a2468cf047a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:09.118956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b271be2a-c168-41f7-a8a5-a2468cf047a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:09.129253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271be2a-c168-41f7-a8a5-a2468cf047a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:09.130701 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b271be2a-c168-41f7-a8a5-a2468cf047a3 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:09.141108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1304/2605] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:09 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:55:09.185174 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce6a76-6f35-488d-8bd9-ddca74596714 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:09.186693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-54ce6a76-6f35-488d-8bd9-ddca74596714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:09.199721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce6a76-6f35-488d-8bd9-ddca74596714 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:09.203511 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be23f-b3fb-4166-8290-b1cac9fbcf38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:09.204165 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be23f-b3fb-4166-8290-b1cac9fbcf38 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:09.204449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be23f-b3fb-4166-8290-b1cac9fbcf38 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:09.204782 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be23f-b3fb-4166-8290-b1cac9fbcf38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:09.271836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92be23f-b3fb-4166-8290-b1cac9fbcf38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:09.274088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92be23f-b3fb-4166-8290-b1cac9fbcf38 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:09.284170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1302/2606] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:09 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:55:10.827009 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c70f-a684-44ab-a997-89926dd6a050 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:10.827565 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c70f-a684-44ab-a997-89926dd6a050 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:10.827565 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8562c70f-a684-44ab-a997-89926dd6a050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:10.845688 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-8562c70f-a684-44ab-a997-89926dd6a050 None None] MFA Rules not processed for user `431688bdedc6443cb3718b6af3cdcc30`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:10.846927 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-8562c70f-a684-44ab-a997-89926dd6a050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:10.903647 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1305/2607] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:10 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:11.163926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be23f-b3fb-4166-8290-b1cac9fbcf38 service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:11.163926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d92be23f-b3fb-4166-8290-b1cac9fbcf38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:11.222363 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be23f-b3fb-4166-8290-b1cac9fbcf38 service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:11.226323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a4a88-5380-4379-9baf-a64b67e5fea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:11.227143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a4a88-5380-4379-9baf-a64b67e5fea1 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:11.227419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a4a88-5380-4379-9baf-a64b67e5fea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:11.227700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a4a88-5380-4379-9baf-a64b67e5fea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:11.229489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-5c6a4a88-5380-4379-9baf-a64b67e5fea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:11.239396 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a4a88-5380-4379-9baf-a64b67e5fea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:11.240859 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a4a88-5380-4379-9baf-a64b67e5fea1 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:11.253694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1303/2608] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:11 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:55:12.590554 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c70f-a684-44ab-a997-89926dd6a050 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:12.665359 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8562c70f-a684-44ab-a997-89926dd6a050 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:12.671877 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:12.672457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:12.672781 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:12.673052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] PATH_INFO: `/v3/users/38a6c581c9f3435c9c76887c36fa74ee` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:12.675524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a6c581c9f3435c9c76887c36fa74ee)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:12.677823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:12.744143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a6c581c9f3435c9c76887c36fa74ee'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:12.760474 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a6c581c9f3435c9c76887c36fa74ee'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:12.761349 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a6c581c9f3435c9c76887c36fa74ee'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:12.769010 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a6c581c9f3435c9c76887c36fa74ee'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:12.779758 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a6c581c9f3435c9c76887c36fa74ee'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:12.787784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1306/2609] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:55:12 2021] DELETE /identity/v3/users/38a6c581c9f3435c9c76887c36fa74ee => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:12.799937 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81509bbc-10d8-4c49-a4b6-dfb2a1ceeab1 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:12.800861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81509bbc-10d8-4c49-a4b6-dfb2a1ceeab1 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:12.801465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81509bbc-10d8-4c49-a4b6-dfb2a1ceeab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:12.832067 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-81509bbc-10d8-4c49-a4b6-dfb2a1ceeab1 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:12.834135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-81509bbc-10d8-4c49-a4b6-dfb2a1ceeab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:12.906016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1304/2610] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:12.916637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:12.918166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:12.992992 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9964d1-b271-491c-bdef-3205a5ad6ca2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:12.996911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be04fe1-b7b2-4d92-836b-0edeb30772cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:12.997566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be04fe1-b7b2-4d92-836b-0edeb30772cc service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:12.997847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be04fe1-b7b2-4d92-836b-0edeb30772cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:12.998120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be04fe1-b7b2-4d92-836b-0edeb30772cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:13.008028 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be04fe1-b7b2-4d92-836b-0edeb30772cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:13.009602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be04fe1-b7b2-4d92-836b-0edeb30772cc service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:13.019659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1307/2611] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:55:13.357632 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81509bbc-10d8-4c49-a4b6-dfb2a1ceeab1 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:13.360059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-81509bbc-10d8-4c49-a4b6-dfb2a1ceeab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:13.373921 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81509bbc-10d8-4c49-a4b6-dfb2a1ceeab1 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:13.379509 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:13.380728 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:13.381013 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:13.381287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] PATH_INFO: `/v3/projects/a01706757bdd4ac6a7e9d76556b4b26a` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:13.383282 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01706757bdd4ac6a7e9d76556b4b26a)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:13.386028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:13.453815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01706757bdd4ac6a7e9d76556b4b26a', 'request_id': 'req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:13.468111 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01706757bdd4ac6a7e9d76556b4b26a', 'request_id': 'req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:13.476584 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01706757bdd4ac6a7e9d76556b4b26a', 'request_id': 'req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:13.487617 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] The token cache is being invalidate because project a01706757bdd4ac6a7e9d76556b4b26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:55:13.487906 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:13.488685 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:13.490622 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1305/2612] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:55:13 2021] DELETE /identity/v3/projects/a01706757bdd4ac6a7e9d76556b4b26a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:13.495137 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be04fe1-b7b2-4d92-836b-0edeb30772cc service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:13.505710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be04fe1-b7b2-4d92-836b-0edeb30772cc service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:13.564861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d282a5d-385e-4901-a982-b3fc8b966092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:13.565743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282a5d-385e-4901-a982-b3fc8b966092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:13.566019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282a5d-385e-4901-a982-b3fc8b966092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:13.566319 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d282a5d-385e-4901-a982-b3fc8b966092 admin admin] PATH_INFO: `/v3/users/0d8301a57f7a499090ba400864d1b6c5` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:13.567694 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d282a5d-385e-4901-a982-b3fc8b966092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8301a57f7a499090ba400864d1b6c5)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:13.570645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d282a5d-385e-4901-a982-b3fc8b966092 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:13.627111 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8d282a5d-385e-4901-a982-b3fc8b966092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8301a57f7a499090ba400864d1b6c5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:13.642364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8d282a5d-385e-4901-a982-b3fc8b966092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8301a57f7a499090ba400864d1b6c5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:13.643128 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8d282a5d-385e-4901-a982-b3fc8b966092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8301a57f7a499090ba400864d1b6c5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:13.651515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8d282a5d-385e-4901-a982-b3fc8b966092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8301a57f7a499090ba400864d1b6c5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:13.659227 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-8d282a5d-385e-4901-a982-b3fc8b966092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8301a57f7a499090ba400864d1b6c5'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:13.670615 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1308/2613] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:55:13 2021] DELETE /identity/v3/users/0d8301a57f7a499090ba400864d1b6c5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:14.074100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:14.077677 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:14.100721 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7cbaa-db87-4495-a8d9-1a84ca1bf8af admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:14.159873 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:14.160846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.161058 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.161333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] PATH_INFO: `/v3/projects/dce58a46423e4980ac8a411a65c40fec` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.162516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dce58a46423e4980ac8a411a65c40fec)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:14.164481 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:14.211321 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dce58a46423e4980ac8a411a65c40fec', 'request_id': 'req-43c464fb-33e9-4140-8944-f2a46826581c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:14.219490 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dce58a46423e4980ac8a411a65c40fec', 'request_id': 'req-43c464fb-33e9-4140-8944-f2a46826581c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:14.226687 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dce58a46423e4980ac8a411a65c40fec', 'request_id': 'req-43c464fb-33e9-4140-8944-f2a46826581c'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:14.236946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] The token cache is being invalidate because project dce58a46423e4980ac8a411a65c40fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:55:14.237230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:14.237896 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43c464fb-33e9-4140-8944-f2a46826581c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:14.239419 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1306/2614] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:55:14 2021] DELETE /identity/v3/projects/dce58a46423e4980ac8a411a65c40fec => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:55:14.245398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b86ae-f600-4d96-bcdf-41f6e66bfa65 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.245668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b86ae-f600-4d96-bcdf-41f6e66bfa65 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.245941 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b86ae-f600-4d96-bcdf-41f6e66bfa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.265355 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e77b86ae-f600-4d96-bcdf-41f6e66bfa65 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:14.266544 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e77b86ae-f600-4d96-bcdf-41f6e66bfa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:14.330213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1309/2615] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:55:14.338418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90f15-c5c1-495e-9a19-cc9be340d065 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.338704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90f15-c5c1-495e-9a19-cc9be340d065 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.338980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b90f15-c5c1-495e-9a19-cc9be340d065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.357434 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-13b90f15-c5c1-495e-9a19-cc9be340d065 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:14.359479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-13b90f15-c5c1-495e-9a19-cc9be340d065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:14.367753 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1307/2616] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:14.372067 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b86ae-f600-4d96-bcdf-41f6e66bfa65 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:14.381420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b86ae-f600-4d96-bcdf-41f6e66bfa65 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:14.386280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a194-e058-431f-b821-cc54905c660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:14.386941 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a194-e058-431f-b821-cc54905c660f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.387222 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a194-e058-431f-b821-cc54905c660f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.387500 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4a194-e058-431f-b821-cc54905c660f admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.388225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4a194-e058-431f-b821-cc54905c660f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:55:14.388527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4a194-e058-431f-b821-cc54905c660f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:14.390168 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4a194-e058-431f-b821-cc54905c660f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:14.401781 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1310/2617] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:55:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:55:14.406048 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b90f15-c5c1-495e-9a19-cc9be340d065 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:14.415445 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b90f15-c5c1-495e-9a19-cc9be340d065 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:14.420673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5610f4-3157-4210-813e-c3e02950e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:14.421379 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5610f4-3157-4210-813e-c3e02950e98c admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.421852 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5610f4-3157-4210-813e-c3e02950e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.422127 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5610f4-3157-4210-813e-c3e02950e98c admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.422845 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5610f4-3157-4210-813e-c3e02950e98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:14.424830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5610f4-3157-4210-813e-c3e02950e98c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:14.454183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1308/2618] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:55:14 2021] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:55:14.455362 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a194-e058-431f-b821-cc54905c660f admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:14.466122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4a194-e058-431f-b821-cc54905c660f admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:14.528614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f623e-ec77-40db-86ae-49830cecf22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:14.529319 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f623e-ec77-40db-86ae-49830cecf22d admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.529595 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f623e-ec77-40db-86ae-49830cecf22d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.529867 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f623e-ec77-40db-86ae-49830cecf22d admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.530559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f623e-ec77-40db-86ae-49830cecf22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:14.532495 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f623e-ec77-40db-86ae-49830cecf22d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:14.554172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1311/2619] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:55:14 2021] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:55:14.558491 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5610f4-3157-4210-813e-c3e02950e98c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:14.568928 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5610f4-3157-4210-813e-c3e02950e98c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:14.574295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafe659-3611-471e-89f0-f871af64dfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:14.575050 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafe659-3611-471e-89f0-f871af64dfc6 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.575389 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafe659-3611-471e-89f0-f871af64dfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.575667 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafe659-3611-471e-89f0-f871af64dfc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.576400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafe659-3611-471e-89f0-f871af64dfc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:14.578078 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafe659-3611-471e-89f0-f871af64dfc6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:14.589628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1309/2620] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:14 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:14.593797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f623e-ec77-40db-86ae-49830cecf22d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:14.604026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f623e-ec77-40db-86ae-49830cecf22d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:14.608991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8725c2-5d6b-4a8b-b370-dc55ea52672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:14.609665 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8725c2-5d6b-4a8b-b370-dc55ea52672c admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.609946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8725c2-5d6b-4a8b-b370-dc55ea52672c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.610237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8725c2-5d6b-4a8b-b370-dc55ea52672c admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.610963 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8725c2-5d6b-4a8b-b370-dc55ea52672c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:14.612586 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8725c2-5d6b-4a8b-b370-dc55ea52672c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:14.623550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1312/2621] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:14.627831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafe659-3611-471e-89f0-f871af64dfc6 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:14.638822 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafe659-3611-471e-89f0-f871af64dfc6 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:14.644245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ebb9a-8b0c-446d-aaa0-7d66d61e5fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:14.645459 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ebb9a-8b0c-446d-aaa0-7d66d61e5fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.645765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ebb9a-8b0c-446d-aaa0-7d66d61e5fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.646036 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ebb9a-8b0c-446d-aaa0-7d66d61e5fe1 admin admin] PATH_INFO: `/v3/projects/4131fed4b9a744dcbafe213d5cf0bcb1/users/366280a1b2c94bd49ddc208893252177/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.663064 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ebb9a-8b0c-446d-aaa0-7d66d61e5fe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4131fed4b9a744dcbafe213d5cf0bcb1, user_id=366280a1b2c94bd49ddc208893252177, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:14.665928 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ebb9a-8b0c-446d-aaa0-7d66d61e5fe1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:14.680990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1310/2622] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:55:14 2021] PUT /identity/v3/projects/4131fed4b9a744dcbafe213d5cf0bcb1/users/366280a1b2c94bd49ddc208893252177/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:14.692459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19809-b618-4c50-9af4-c7490cbdb5f9 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.693024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19809-b618-4c50-9af4-c7490cbdb5f9 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.693024 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f19809-b618-4c50-9af4-c7490cbdb5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.719854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-40f19809-b618-4c50-9af4-c7490cbdb5f9 None None] MFA Rules not processed for user `366280a1b2c94bd49ddc208893252177`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:14.721105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-40f19809-b618-4c50-9af4-c7490cbdb5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:14.785680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1313/2623] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:14 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:14.790881 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ebb9a-8b0c-446d-aaa0-7d66d61e5fe1 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:14.850871 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ebb9a-8b0c-446d-aaa0-7d66d61e5fe1 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:14.855390 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7965c-ed35-4998-bdc1-c84bc03d539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:14.856046 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7965c-ed35-4998-bdc1-c84bc03d539e admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.856320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7965c-ed35-4998-bdc1-c84bc03d539e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.856594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7965c-ed35-4998-bdc1-c84bc03d539e admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.857309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7965c-ed35-4998-bdc1-c84bc03d539e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:14.859574 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7965c-ed35-4998-bdc1-c84bc03d539e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:14.888176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1311/2624] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:55:14 2021] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:55:14.892158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f19809-b618-4c50-9af4-c7490cbdb5f9 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:14.903004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f19809-b618-4c50-9af4-c7490cbdb5f9 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:14.958573 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4edd96-3b8e-496a-a29d-5ddf136f79ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:14.959248 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4edd96-3b8e-496a-a29d-5ddf136f79ce admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:14.959524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4edd96-3b8e-496a-a29d-5ddf136f79ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:14.959799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4edd96-3b8e-496a-a29d-5ddf136f79ce admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:14.961155 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4edd96-3b8e-496a-a29d-5ddf136f79ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:14.963089 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4edd96-3b8e-496a-a29d-5ddf136f79ce admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:14.988120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1314/2625] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:55:14 2021] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:55:14.989773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7965c-ed35-4998-bdc1-c84bc03d539e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:15.000897 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7965c-ed35-4998-bdc1-c84bc03d539e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:15.008023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa8753-d494-4a42-9754-e856790f0a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:15.008823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa8753-d494-4a42-9754-e856790f0a97 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:15.009169 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa8753-d494-4a42-9754-e856790f0a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:15.009525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa8753-d494-4a42-9754-e856790f0a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:15.010261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa8753-d494-4a42-9754-e856790f0a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:15.011880 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa8753-d494-4a42-9754-e856790f0a97 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:15.022901 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1312/2626] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:14 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:15.027285 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4edd96-3b8e-496a-a29d-5ddf136f79ce admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:15.037320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4edd96-3b8e-496a-a29d-5ddf136f79ce admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:15.042025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32ad66-4273-4b8b-9f2b-0789c8db3bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:15.042903 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32ad66-4273-4b8b-9f2b-0789c8db3bad admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:15.043177 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32ad66-4273-4b8b-9f2b-0789c8db3bad admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:15.043465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e32ad66-4273-4b8b-9f2b-0789c8db3bad admin admin] PATH_INFO: `/v3/projects/6e2a4e7f21fb47a6aafd5f13bea853e0/users/e0d517762bcf4812bcba082bc85d6234/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:15.057791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32ad66-4273-4b8b-9f2b-0789c8db3bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2a4e7f21fb47a6aafd5f13bea853e0, user_id=e0d517762bcf4812bcba082bc85d6234, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:15.060447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e32ad66-4273-4b8b-9f2b-0789c8db3bad admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:15.076921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1315/2627] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:55:15 2021] PUT /identity/v3/projects/6e2a4e7f21fb47a6aafd5f13bea853e0/users/e0d517762bcf4812bcba082bc85d6234/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:55:15.081245 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa8753-d494-4a42-9754-e856790f0a97 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:15.092287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa8753-d494-4a42-9754-e856790f0a97 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:15.152401 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b10a10-9991-4cfa-9770-f1c0a5866575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:15.153115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b10a10-9991-4cfa-9770-f1c0a5866575 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:15.153393 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b10a10-9991-4cfa-9770-f1c0a5866575 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:15.153666 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b10a10-9991-4cfa-9770-f1c0a5866575 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:15.154409 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b10a10-9991-4cfa-9770-f1c0a5866575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:15.156007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b10a10-9991-4cfa-9770-f1c0a5866575 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:15.166162 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1313/2628] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:15 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:15.170602 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32ad66-4273-4b8b-9f2b-0789c8db3bad admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:15.181261 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e32ad66-4273-4b8b-9f2b-0789c8db3bad admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:15.187628 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580d509-b427-4da8-8ff1-9d98138153ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:15.188550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580d509-b427-4da8-8ff1-9d98138153ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:15.188866 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580d509-b427-4da8-8ff1-9d98138153ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:15.189135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580d509-b427-4da8-8ff1-9d98138153ab admin admin] PATH_INFO: `/v3/projects/6e2a4e7f21fb47a6aafd5f13bea853e0/users/e0d517762bcf4812bcba082bc85d6234/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:15.195139 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580d509-b427-4da8-8ff1-9d98138153ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2a4e7f21fb47a6aafd5f13bea853e0, user_id=e0d517762bcf4812bcba082bc85d6234, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:15.197958 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580d509-b427-4da8-8ff1-9d98138153ab admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:15.209288 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1316/2629] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:55:15 2021] PUT /identity/v3/projects/6e2a4e7f21fb47a6aafd5f13bea853e0/users/e0d517762bcf4812bcba082bc85d6234/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:15.220056 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0487-07ff-4f27-b075-ce437ed9068e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:15.220337 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0487-07ff-4f27-b075-ce437ed9068e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:15.220648 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0487-07ff-4f27-b075-ce437ed9068e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:15.247736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f43f0487-07ff-4f27-b075-ce437ed9068e None None] MFA Rules not processed for user `e0d517762bcf4812bcba082bc85d6234`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:15.248970 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f43f0487-07ff-4f27-b075-ce437ed9068e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:15.317938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1314/2630] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:15 2021] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:15.328836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580d509-b427-4da8-8ff1-9d98138153ab admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:15.331006 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9580d509-b427-4da8-8ff1-9d98138153ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:15.390702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580d509-b427-4da8-8ff1-9d98138153ab admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:15.394713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae0990-0b3d-45cf-927f-253bfb698c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:15.395262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae0990-0b3d-45cf-927f-253bfb698c8e service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:15.395624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae0990-0b3d-45cf-927f-253bfb698c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:15.395890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae0990-0b3d-45cf-927f-253bfb698c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:15.406948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae0990-0b3d-45cf-927f-253bfb698c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:15.409442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bae0990-0b3d-45cf-927f-253bfb698c8e service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:15.425598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1317/2631] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:15 2021] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:55:15.521798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f0487-07ff-4f27-b075-ce437ed9068e None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:15.531934 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f0487-07ff-4f27-b075-ce437ed9068e None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:15.535894 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dea6c-979b-46b7-b8fd-373cd2a87d89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:15.536564 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dea6c-979b-46b7-b8fd-373cd2a87d89 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:15.536809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dea6c-979b-46b7-b8fd-373cd2a87d89 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:15.537110 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dea6c-979b-46b7-b8fd-373cd2a87d89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:15.594241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dea6c-979b-46b7-b8fd-373cd2a87d89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:15.595687 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dea6c-979b-46b7-b8fd-373cd2a87d89 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:15.604633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1315/2632] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:15 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:55:20.373317 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae0990-0b3d-45cf-927f-253bfb698c8e service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:20.438621 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae0990-0b3d-45cf-927f-253bfb698c8e service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:20.443578 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:20.444481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:20.444797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:20.445074 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] PATH_INFO: `/v3/users/366280a1b2c94bd49ddc208893252177` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:20.446574 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=366280a1b2c94bd49ddc208893252177)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:20.448282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:20.508114 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366280a1b2c94bd49ddc208893252177'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:20.521005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366280a1b2c94bd49ddc208893252177'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:20.521728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366280a1b2c94bd49ddc208893252177'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:20.529269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366280a1b2c94bd49ddc208893252177'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:20.538971 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366280a1b2c94bd49ddc208893252177'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:20.545306 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1318/2633] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:55:20 2021] DELETE /identity/v3/users/366280a1b2c94bd49ddc208893252177 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:55:20.552138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771160-2811-4d70-a7ee-f86473e8f83c None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:20.552665 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771160-2811-4d70-a7ee-f86473e8f83c None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:20.552776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e771160-2811-4d70-a7ee-f86473e8f83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:20.572972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7e771160-2811-4d70-a7ee-f86473e8f83c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:20.574153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7e771160-2811-4d70-a7ee-f86473e8f83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:20.636270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1316/2634] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:20.649992 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:20.651525 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:20.712954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312e504-5dfa-4361-83d5-d9b4504766cf admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:20.716711 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c796bf-6a25-4206-919f-e64b87e4a7cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:20.717361 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c796bf-6a25-4206-919f-e64b87e4a7cc service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:20.717639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c796bf-6a25-4206-919f-e64b87e4a7cc service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:20.717907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c796bf-6a25-4206-919f-e64b87e4a7cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:20.726878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c796bf-6a25-4206-919f-e64b87e4a7cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:20.731545 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c796bf-6a25-4206-919f-e64b87e4a7cc service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:20.739684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1319/2635] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:20 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:55:21.043980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e771160-2811-4d70-a7ee-f86473e8f83c None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:21.045517 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7e771160-2811-4d70-a7ee-f86473e8f83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:21.058719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e771160-2811-4d70-a7ee-f86473e8f83c None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:21.063877 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:21.064862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:21.065207 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:21.065516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] PATH_INFO: `/v3/projects/4131fed4b9a744dcbafe213d5cf0bcb1` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:21.066850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4131fed4b9a744dcbafe213d5cf0bcb1)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:21.068943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:21.118235 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4131fed4b9a744dcbafe213d5cf0bcb1', 'request_id': 'req-32969874-23c5-41ae-84b6-a138629aed32'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.129202 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4131fed4b9a744dcbafe213d5cf0bcb1', 'request_id': 'req-32969874-23c5-41ae-84b6-a138629aed32'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.136639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4131fed4b9a744dcbafe213d5cf0bcb1', 'request_id': 'req-32969874-23c5-41ae-84b6-a138629aed32'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.147320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] The token cache is being invalidate because project 4131fed4b9a744dcbafe213d5cf0bcb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:55:21.147606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.148261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.149872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1317/2636] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:55:21 2021] DELETE /identity/v3/projects/4131fed4b9a744dcbafe213d5cf0bcb1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:21.154200 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c796bf-6a25-4206-919f-e64b87e4a7cc service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:21.165339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c796bf-6a25-4206-919f-e64b87e4a7cc service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:21.247971 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e1e96-10cc-4520-bdbb-85c393ec0ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:21.248878 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e1e96-10cc-4520-bdbb-85c393ec0ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:21.249189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e1e96-10cc-4520-bdbb-85c393ec0ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:21.249436 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e1e96-10cc-4520-bdbb-85c393ec0ddf admin admin] PATH_INFO: `/v3/users/e0d517762bcf4812bcba082bc85d6234` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:21.250819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e1e96-10cc-4520-bdbb-85c393ec0ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d517762bcf4812bcba082bc85d6234)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:21.252787 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e1e96-10cc-4520-bdbb-85c393ec0ddf admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:21.300473 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f98e1e96-10cc-4520-bdbb-85c393ec0ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d517762bcf4812bcba082bc85d6234'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.313153 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f98e1e96-10cc-4520-bdbb-85c393ec0ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d517762bcf4812bcba082bc85d6234'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.314188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f98e1e96-10cc-4520-bdbb-85c393ec0ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d517762bcf4812bcba082bc85d6234'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.321207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f98e1e96-10cc-4520-bdbb-85c393ec0ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d517762bcf4812bcba082bc85d6234'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.329954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f98e1e96-10cc-4520-bdbb-85c393ec0ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d517762bcf4812bcba082bc85d6234'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.336755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1320/2637] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:55:21 2021] DELETE /identity/v3/users/e0d517762bcf4812bcba082bc85d6234 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:21.656400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:21.658131 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:21.675187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32969874-23c5-41ae-84b6-a138629aed32 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:21.736604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:21.737470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:21.737941 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:21.738375 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] PATH_INFO: `/v3/projects/6e2a4e7f21fb47a6aafd5f13bea853e0` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:21.739556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2a4e7f21fb47a6aafd5f13bea853e0)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:21.741875 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:21.799430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2a4e7f21fb47a6aafd5f13bea853e0', 'request_id': 'req-23320e3c-b454-429a-a734-2c6193afe2fe'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.809733 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2a4e7f21fb47a6aafd5f13bea853e0', 'request_id': 'req-23320e3c-b454-429a-a734-2c6193afe2fe'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.817727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2a4e7f21fb47a6aafd5f13bea853e0', 'request_id': 'req-23320e3c-b454-429a-a734-2c6193afe2fe'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.830855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] The token cache is being invalidate because project 6e2a4e7f21fb47a6aafd5f13bea853e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:55:21.831198 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.831811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-23320e3c-b454-429a-a734-2c6193afe2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:21.833879 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1318/2638] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:55:21 2021] DELETE /identity/v3/projects/6e2a4e7f21fb47a6aafd5f13bea853e0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:21.841573 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df709b-3660-482e-804e-5d26ab955670 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:21.842104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df709b-3660-482e-804e-5d26ab955670 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:21.842104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df709b-3660-482e-804e-5d26ab955670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:21.863980 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-f2df709b-3660-482e-804e-5d26ab955670 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:21.865319 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f2df709b-3660-482e-804e-5d26ab955670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:21.927084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1321/2639] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:21.937848 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cbb43-0184-4608-8e58-bbad9c1e474a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:21.938187 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cbb43-0184-4608-8e58-bbad9c1e474a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:21.938457 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cbb43-0184-4608-8e58-bbad9c1e474a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:21.961887 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-cb8cbb43-0184-4608-8e58-bbad9c1e474a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:21.963460 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-cb8cbb43-0184-4608-8e58-bbad9c1e474a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:21.972561 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1319/2640] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:21 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:21.978450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df709b-3660-482e-804e-5d26ab955670 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:21.989828 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df709b-3660-482e-804e-5d26ab955670 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:22.001945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd15b82-a3c6-4971-89e6-fa28420194e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:22.002976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd15b82-a3c6-4971-89e6-fa28420194e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:22.003393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd15b82-a3c6-4971-89e6-fa28420194e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:22.003843 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd15b82-a3c6-4971-89e6-fa28420194e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:22.004799 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd15b82-a3c6-4971-89e6-fa28420194e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:55:22.005174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd15b82-a3c6-4971-89e6-fa28420194e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:22.007669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd15b82-a3c6-4971-89e6-fa28420194e9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:22.022660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1322/2641] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:55:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:55:22.027378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cbb43-0184-4608-8e58-bbad9c1e474a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:22.037286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cbb43-0184-4608-8e58-bbad9c1e474a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:22.043149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c71b1-a63b-4cf4-86fb-02cc2b6ce52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:22.044143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c71b1-a63b-4cf4-86fb-02cc2b6ce52a admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:22.044493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c71b1-a63b-4cf4-86fb-02cc2b6ce52a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:22.044827 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c71b1-a63b-4cf4-86fb-02cc2b6ce52a admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:22.045634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c71b1-a63b-4cf4-86fb-02cc2b6ce52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:22.047787 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115c71b1-a63b-4cf4-86fb-02cc2b6ce52a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:22.074883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1320/2642] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:55:22 2021] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:55:22.079500 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd15b82-a3c6-4971-89e6-fa28420194e9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:22.090212 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd15b82-a3c6-4971-89e6-fa28420194e9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:22.159470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885b4d-e182-4051-b947-b690d564723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:22.160039 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885b4d-e182-4051-b947-b690d564723c admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:22.160322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885b4d-e182-4051-b947-b690d564723c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:22.160615 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c885b4d-e182-4051-b947-b690d564723c admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:22.161363 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c885b4d-e182-4051-b947-b690d564723c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:22.163272 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c885b4d-e182-4051-b947-b690d564723c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:22.184388 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1323/2643] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:55:22 2021] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:55:22.189606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c71b1-a63b-4cf4-86fb-02cc2b6ce52a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:22.203792 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115c71b1-a63b-4cf4-86fb-02cc2b6ce52a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:22.209703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe5550-0897-4637-8661-7fcf878f8b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:22.210373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5550-0897-4637-8661-7fcf878f8b31 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:22.210657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5550-0897-4637-8661-7fcf878f8b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:22.211274 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe5550-0897-4637-8661-7fcf878f8b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:22.212151 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe5550-0897-4637-8661-7fcf878f8b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:22.213962 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe5550-0897-4637-8661-7fcf878f8b31 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:22.225394 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1321/2644] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:22.230035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885b4d-e182-4051-b947-b690d564723c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:22.240874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c885b4d-e182-4051-b947-b690d564723c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:22.246216 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5d300-1b0a-4ee3-b5bd-459304713357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:22.246933 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5d300-1b0a-4ee3-b5bd-459304713357 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:22.247244 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5d300-1b0a-4ee3-b5bd-459304713357 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:22.247685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5d300-1b0a-4ee3-b5bd-459304713357 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:22.248463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5d300-1b0a-4ee3-b5bd-459304713357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:22.250334 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5d300-1b0a-4ee3-b5bd-459304713357 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:22.262263 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1324/2645] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:22.266618 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe5550-0897-4637-8661-7fcf878f8b31 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:22.277699 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe5550-0897-4637-8661-7fcf878f8b31 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:22.282723 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac863cf6-70d5-4edc-96d1-30b9dea777dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:22.283630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac863cf6-70d5-4edc-96d1-30b9dea777dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:22.283901 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac863cf6-70d5-4edc-96d1-30b9dea777dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:22.284176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac863cf6-70d5-4edc-96d1-30b9dea777dd admin admin] PATH_INFO: `/v3/projects/ea3cebe5c55b43ba87ef91c21a2e5870/users/0954be55ac7f4b139bb88c0cbaf9d435/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:22.300157 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac863cf6-70d5-4edc-96d1-30b9dea777dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea3cebe5c55b43ba87ef91c21a2e5870, user_id=0954be55ac7f4b139bb88c0cbaf9d435, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:22.302867 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac863cf6-70d5-4edc-96d1-30b9dea777dd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:22.317657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1322/2646] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:55:22 2021] PUT /identity/v3/projects/ea3cebe5c55b43ba87ef91c21a2e5870/users/0954be55ac7f4b139bb88c0cbaf9d435/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:22.330282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1399688-9f54-4fc0-8e59-e994f8d1e17b None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:22.330572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1399688-9f54-4fc0-8e59-e994f8d1e17b None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:22.330850 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1399688-9f54-4fc0-8e59-e994f8d1e17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:22.360747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a1399688-9f54-4fc0-8e59-e994f8d1e17b None None] MFA Rules not processed for user `0954be55ac7f4b139bb88c0cbaf9d435`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:22.361961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a1399688-9f54-4fc0-8e59-e994f8d1e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:22.430472 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1325/2647] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:22 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:22.441803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac863cf6-70d5-4edc-96d1-30b9dea777dd admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:22.443889 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-ac863cf6-70d5-4edc-96d1-30b9dea777dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:22.510988 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac863cf6-70d5-4edc-96d1-30b9dea777dd admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:22.516362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84659d-acdd-47c5-9f1a-e13589721264 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:22.517047 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84659d-acdd-47c5-9f1a-e13589721264 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:22.517322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84659d-acdd-47c5-9f1a-e13589721264 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:22.517590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84659d-acdd-47c5-9f1a-e13589721264 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:22.534890 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84659d-acdd-47c5-9f1a-e13589721264 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:22.537268 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84659d-acdd-47c5-9f1a-e13589721264 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:22.548784 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1323/2648] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:22 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:55:34.279496 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5a171-2feb-4fff-a99d-b1de13c9119c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:34.280109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5a171-2feb-4fff-a99d-b1de13c9119c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:34.280212 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5a171-2feb-4fff-a99d-b1de13c9119c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:34.299278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c6d5a171-2feb-4fff-a99d-b1de13c9119c None None] MFA Rules not processed for user `431688bdedc6443cb3718b6af3cdcc30`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:34.300647 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c6d5a171-2feb-4fff-a99d-b1de13c9119c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:34.357797 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1326/2649] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:34 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:42.263573 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84659d-acdd-47c5-9f1a-e13589721264 service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:42.339559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84659d-acdd-47c5-9f1a-e13589721264 service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:42.344850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:42.345728 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:42.345971 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:42.346276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] PATH_INFO: `/v3/users/0954be55ac7f4b139bb88c0cbaf9d435` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:42.347513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0954be55ac7f4b139bb88c0cbaf9d435)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:42.349429 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:42.398628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0954be55ac7f4b139bb88c0cbaf9d435'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:42.411072 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0954be55ac7f4b139bb88c0cbaf9d435'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:42.419277 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0954be55ac7f4b139bb88c0cbaf9d435'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:42.426571 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0954be55ac7f4b139bb88c0cbaf9d435'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:42.427337 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0954be55ac7f4b139bb88c0cbaf9d435'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:42.433847 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1324/2650] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:55:42 2021] DELETE /identity/v3/users/0954be55ac7f4b139bb88c0cbaf9d435 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:42.438720 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bd08-7278-4ffc-8229-e79e68c96cd2 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:42.439223 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bd08-7278-4ffc-8229-e79e68c96cd2 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:42.439318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60bd08-7278-4ffc-8229-e79e68c96cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:42.458099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-fe60bd08-7278-4ffc-8229-e79e68c96cd2 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:42.459265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fe60bd08-7278-4ffc-8229-e79e68c96cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:42.517794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1327/2651] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:42.528140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:42.529875 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:42.596482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6b891-b870-489b-af34-c1799f9ad101 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:42.603271 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80387a7-0570-4242-94d3-8a6177ea8b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:42.603976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80387a7-0570-4242-94d3-8a6177ea8b91 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:42.604219 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80387a7-0570-4242-94d3-8a6177ea8b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:42.604518 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80387a7-0570-4242-94d3-8a6177ea8b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:42.615423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80387a7-0570-4242-94d3-8a6177ea8b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:42.616963 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80387a7-0570-4242-94d3-8a6177ea8b91 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:42.626925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1325/2652] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:55:42.905998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60bd08-7278-4ffc-8229-e79e68c96cd2 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:42.907539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fe60bd08-7278-4ffc-8229-e79e68c96cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:42.919999 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60bd08-7278-4ffc-8229-e79e68c96cd2 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:42.925562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:42.926575 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:42.926946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:42.927325 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] PATH_INFO: `/v3/projects/ea3cebe5c55b43ba87ef91c21a2e5870` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:42.928648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea3cebe5c55b43ba87ef91c21a2e5870)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:42.930654 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:42.994522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea3cebe5c55b43ba87ef91c21a2e5870', 'request_id': 'req-9b096e05-0922-4962-8953-985c2085531d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:43.003684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea3cebe5c55b43ba87ef91c21a2e5870', 'request_id': 'req-9b096e05-0922-4962-8953-985c2085531d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:43.010779 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea3cebe5c55b43ba87ef91c21a2e5870', 'request_id': 'req-9b096e05-0922-4962-8953-985c2085531d'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:43.022430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] The token cache is being invalidate because project ea3cebe5c55b43ba87ef91c21a2e5870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:55:43.022717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:43.023447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-9b096e05-0922-4962-8953-985c2085531d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:55:43.029460 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1328/2653] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:55:42 2021] DELETE /identity/v3/projects/ea3cebe5c55b43ba87ef91c21a2e5870 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:43.031254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8b61-428b-44bf-a407-cc5b7b6eb129 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:43.031628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8b61-428b-44bf-a407-cc5b7b6eb129 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:43.031981 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8b61-428b-44bf-a407-cc5b7b6eb129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:43.051285 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-85bf8b61-428b-44bf-a407-cc5b7b6eb129 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:43.052553 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-85bf8b61-428b-44bf-a407-cc5b7b6eb129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:43.113427 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1326/2654] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:55:43.121637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8969be-bc27-4c4d-8696-ede02c2900b6 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:43.121919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8969be-bc27-4c4d-8696-ede02c2900b6 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:43.122215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8969be-bc27-4c4d-8696-ede02c2900b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:43.142681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-0a8969be-bc27-4c4d-8696-ede02c2900b6 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:43.144078 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-0a8969be-bc27-4c4d-8696-ede02c2900b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:43.152848 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1329/2655] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:55:43.158628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf8b61-428b-44bf-a407-cc5b7b6eb129 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:43.169014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf8b61-428b-44bf-a407-cc5b7b6eb129 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:43.175112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a414619-40b2-47ae-92e1-b8b67320439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:43.175926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a414619-40b2-47ae-92e1-b8b67320439e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:43.176215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a414619-40b2-47ae-92e1-b8b67320439e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:43.176479 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a414619-40b2-47ae-92e1-b8b67320439e admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:43.177244 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a414619-40b2-47ae-92e1-b8b67320439e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:55:43.177544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a414619-40b2-47ae-92e1-b8b67320439e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:43.179135 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a414619-40b2-47ae-92e1-b8b67320439e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:43.191073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1327/2656] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:55:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:55:43.195638 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8969be-bc27-4c4d-8696-ede02c2900b6 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:43.205430 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8969be-bc27-4c4d-8696-ede02c2900b6 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:43.211532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001e7db-8195-454c-8934-0d35c1fd9a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:43.212204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001e7db-8195-454c-8934-0d35c1fd9a46 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:43.212455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001e7db-8195-454c-8934-0d35c1fd9a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:43.212766 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001e7db-8195-454c-8934-0d35c1fd9a46 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:43.213464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001e7db-8195-454c-8934-0d35c1fd9a46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:43.215401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001e7db-8195-454c-8934-0d35c1fd9a46 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:43.251603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1330/2657] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:55:43 2021] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:55:43.256192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a414619-40b2-47ae-92e1-b8b67320439e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:43.269943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a414619-40b2-47ae-92e1-b8b67320439e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:43.329309 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db5046-f021-4b33-8ed5-3bb14c24de23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:43.329992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db5046-f021-4b33-8ed5-3bb14c24de23 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:43.330276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db5046-f021-4b33-8ed5-3bb14c24de23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:43.330552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db5046-f021-4b33-8ed5-3bb14c24de23 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:43.331297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db5046-f021-4b33-8ed5-3bb14c24de23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:43.333287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db5046-f021-4b33-8ed5-3bb14c24de23 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:43.361418 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1328/2658] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:55:43 2021] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:55:43.362610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001e7db-8195-454c-8934-0d35c1fd9a46 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:43.373129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001e7db-8195-454c-8934-0d35c1fd9a46 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:43.378582 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0cf1-1b0b-4c9d-95c0-d17da5f90709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:43.379249 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0cf1-1b0b-4c9d-95c0-d17da5f90709 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:43.379533 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0cf1-1b0b-4c9d-95c0-d17da5f90709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:43.379807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f0cf1-1b0b-4c9d-95c0-d17da5f90709 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:43.380550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f0cf1-1b0b-4c9d-95c0-d17da5f90709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:43.382189 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f0cf1-1b0b-4c9d-95c0-d17da5f90709 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:43.395772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1331/2659] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:43 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:43.396989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db5046-f021-4b33-8ed5-3bb14c24de23 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:43.407353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db5046-f021-4b33-8ed5-3bb14c24de23 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:43.412303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca619c-693a-4c96-94db-ec1c233b276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:43.413002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca619c-693a-4c96-94db-ec1c233b276a admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:43.413286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca619c-693a-4c96-94db-ec1c233b276a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:43.413562 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca619c-693a-4c96-94db-ec1c233b276a admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:43.414307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca619c-693a-4c96-94db-ec1c233b276a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:43.415929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca619c-693a-4c96-94db-ec1c233b276a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:43.426712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1329/2660] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:55:43 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:55:43.430719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0cf1-1b0b-4c9d-95c0-d17da5f90709 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:43.440762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f0cf1-1b0b-4c9d-95c0-d17da5f90709 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:43.453463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36281b4c-ef31-4ba6-90b1-1824d08e6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:43.454382 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36281b4c-ef31-4ba6-90b1-1824d08e6a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:43.454654 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36281b4c-ef31-4ba6-90b1-1824d08e6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:43.454924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36281b4c-ef31-4ba6-90b1-1824d08e6a50 admin admin] PATH_INFO: `/v3/projects/c2c012e0f9a44258850f7026e65a6ec2/users/8501035d3f3c4a46a05b72b8234befac/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:43.469634 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36281b4c-ef31-4ba6-90b1-1824d08e6a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2c012e0f9a44258850f7026e65a6ec2, user_id=8501035d3f3c4a46a05b72b8234befac, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:43.472244 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36281b4c-ef31-4ba6-90b1-1824d08e6a50 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:43.487563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1332/2661] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:55:43 2021] PUT /identity/v3/projects/c2c012e0f9a44258850f7026e65a6ec2/users/8501035d3f3c4a46a05b72b8234befac/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:55:43.492987 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ef9e9-d6d1-49cc-af5b-81957a5f669e None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:43.493275 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ef9e9-d6d1-49cc-af5b-81957a5f669e None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:43.493604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ef9e9-d6d1-49cc-af5b-81957a5f669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:43.511579 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-220ef9e9-d6d1-49cc-af5b-81957a5f669e None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:43.512775 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-220ef9e9-d6d1-49cc-af5b-81957a5f669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:43.571483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1330/2662] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:55:43.585458 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36281b4c-ef31-4ba6-90b1-1824d08e6a50 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:43.587757 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-36281b4c-ef31-4ba6-90b1-1824d08e6a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:43.653324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36281b4c-ef31-4ba6-90b1-1824d08e6a50 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:43.658068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd35b28-e9a0-415f-8f76-7a13daf152be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:43.658717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd35b28-e9a0-415f-8f76-7a13daf152be service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:43.658997 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd35b28-e9a0-415f-8f76-7a13daf152be service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:43.659269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd35b28-e9a0-415f-8f76-7a13daf152be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:43.672129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd35b28-e9a0-415f-8f76-7a13daf152be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:43.672129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd35b28-e9a0-415f-8f76-7a13daf152be service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:43.680403 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1333/2663] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:55:44.440755 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df640f68-fe53-4f00-8d43-fcd66ce8d375 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:44.440755 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df640f68-fe53-4f00-8d43-fcd66ce8d375 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:44.443451 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df640f68-fe53-4f00-8d43-fcd66ce8d375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:44.472089 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-df640f68-fe53-4f00-8d43-fcd66ce8d375 None None] MFA Rules not processed for user `8501035d3f3c4a46a05b72b8234befac`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:44.473347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-df640f68-fe53-4f00-8d43-fcd66ce8d375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:44.542093 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1331/2664] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:44 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:44.552262 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd35b28-e9a0-415f-8f76-7a13daf152be service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:55:44.553840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1cd35b28-e9a0-415f-8f76-7a13daf152be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:44.617413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd35b28-e9a0-415f-8f76-7a13daf152be service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:55:44.621451 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf4be2-9a53-44c0-85c5-ac9f4d5f78aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:55:44.622107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf4be2-9a53-44c0-85c5-ac9f4d5f78aa service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:44.622391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf4be2-9a53-44c0-85c5-ac9f4d5f78aa service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:44.622721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf4be2-9a53-44c0-85c5-ac9f4d5f78aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:44.634058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf4be2-9a53-44c0-85c5-ac9f4d5f78aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:55:44.635715 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf4be2-9a53-44c0-85c5-ac9f4d5f78aa service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:55:44.648887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1334/2665] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:55:44 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:55:46.023757 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c0464-cda8-4937-b82f-c59651239409 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:46.024355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c0464-cda8-4937-b82f-c59651239409 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:46.024355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c0464-cda8-4937-b82f-c59651239409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:46.042706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-8e2c0464-cda8-4937-b82f-c59651239409 None None] MFA Rules not processed for user `8501035d3f3c4a46a05b72b8234befac`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:46.043905 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-8e2c0464-cda8-4937-b82f-c59651239409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:46.051585 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1332/2666] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:46 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:55:59.236728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508b967-1576-4bd8-85df-73060242b2c0 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:55:59.237372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508b967-1576-4bd8-85df-73060242b2c0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:55:59.237372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508b967-1576-4bd8-85df-73060242b2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:55:59.260291 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a508b967-1576-4bd8-85df-73060242b2c0 None None] MFA Rules not processed for user `8501035d3f3c4a46a05b72b8234befac`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:55:59.261536 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a508b967-1576-4bd8-85df-73060242b2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:55:59.269414 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1335/2667] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:55:59 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:17.167644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d056f-76d4-4eae-aa98-f231fb8108b2 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:17.168231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d056f-76d4-4eae-aa98-f231fb8108b2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:17.168231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d056f-76d4-4eae-aa98-f231fb8108b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:17.188197 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-244d056f-76d4-4eae-aa98-f231fb8108b2 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:17.189442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-244d056f-76d4-4eae-aa98-f231fb8108b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:17.264956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1333/2668] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:56:17 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:17.334894 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508b967-1576-4bd8-85df-73060242b2c0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:17.340326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a508b967-1576-4bd8-85df-73060242b2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:17.422702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508b967-1576-4bd8-85df-73060242b2c0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:17.428998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cae0c-e350-4624-accd-c207413136a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:17.429825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cae0c-e350-4624-accd-c207413136a4 service swift] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:17.430108 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cae0c-e350-4624-accd-c207413136a4 service swift] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:17.430402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cae0c-e350-4624-accd-c207413136a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:17.439461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cae0c-e350-4624-accd-c207413136a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:17.441273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2cae0c-e350-4624-accd-c207413136a4 service swift] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:17.451931 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1336/2669] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:56:17 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:56:18.461442 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d056f-76d4-4eae-aa98-f231fb8108b2 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:18.465863 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-244d056f-76d4-4eae-aa98-f231fb8108b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:18.488224 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d056f-76d4-4eae-aa98-f231fb8108b2 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:18.492606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa35a3f-85c6-4de5-a543-8b5038c2061a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:18.493320 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa35a3f-85c6-4de5-a543-8b5038c2061a service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:18.495159 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa35a3f-85c6-4de5-a543-8b5038c2061a service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:18.495927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa35a3f-85c6-4de5-a543-8b5038c2061a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:18.499698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-aaa35a3f-85c6-4de5-a543-8b5038c2061a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:18.513909 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa35a3f-85c6-4de5-a543-8b5038c2061a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:18.515632 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa35a3f-85c6-4de5-a543-8b5038c2061a service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:18.529198 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1334/2670] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:18 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:56:19.788636 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cae0c-e350-4624-accd-c207413136a4 service swift] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:19.790771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-8c2cae0c-e350-4624-accd-c207413136a4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:19.820589 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cae0c-e350-4624-accd-c207413136a4 service swift] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:19.832141 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29930a71-5e41-4cb7-8e94-103f344c3355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:19.833459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29930a71-5e41-4cb7-8e94-103f344c3355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:19.833943 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29930a71-5e41-4cb7-8e94-103f344c3355 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:19.834447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29930a71-5e41-4cb7-8e94-103f344c3355 admin admin] PATH_INFO: `/v3/users/431688bdedc6443cb3718b6af3cdcc30` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:19.836420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29930a71-5e41-4cb7-8e94-103f344c3355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=431688bdedc6443cb3718b6af3cdcc30)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:19.840142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29930a71-5e41-4cb7-8e94-103f344c3355 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:19.908156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-29930a71-5e41-4cb7-8e94-103f344c3355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '431688bdedc6443cb3718b6af3cdcc30'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:19.925339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-29930a71-5e41-4cb7-8e94-103f344c3355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '431688bdedc6443cb3718b6af3cdcc30'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:19.926378 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-29930a71-5e41-4cb7-8e94-103f344c3355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '431688bdedc6443cb3718b6af3cdcc30'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:19.936440 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-29930a71-5e41-4cb7-8e94-103f344c3355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '431688bdedc6443cb3718b6af3cdcc30'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:19.949041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-29930a71-5e41-4cb7-8e94-103f344c3355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '431688bdedc6443cb3718b6af3cdcc30'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:19.966438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1337/2671] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:56:19 2021] DELETE /identity/v3/users/431688bdedc6443cb3718b6af3cdcc30 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:20.223373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa35a3f-85c6-4de5-a543-8b5038c2061a service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:20.239850 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa35a3f-85c6-4de5-a543-8b5038c2061a service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:20.337607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:20.338793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:20.339241 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:20.339661 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] PATH_INFO: `/v3/projects/c6d1af29ea9c44a7870cae601abfe353` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:20.341223 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d1af29ea9c44a7870cae601abfe353)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:20.344022 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:20.405322 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d1af29ea9c44a7870cae601abfe353', 'request_id': 'req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:20.420141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d1af29ea9c44a7870cae601abfe353', 'request_id': 'req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:20.429417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d1af29ea9c44a7870cae601abfe353', 'request_id': 'req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:20.441747 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] The token cache is being invalidate because project c6d1af29ea9c44a7870cae601abfe353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:56:20.442049 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:20.443891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-43b5bed5-a7a6-47ff-88d6-67fcc14652f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:20.450424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1335/2672] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:56:20 2021] DELETE /identity/v3/projects/c6d1af29ea9c44a7870cae601abfe353 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:20.451981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98a1ae-47b3-46ec-9bed-0c9ee6ca7e34 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:20.452391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98a1ae-47b3-46ec-9bed-0c9ee6ca7e34 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:20.452842 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98a1ae-47b3-46ec-9bed-0c9ee6ca7e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:20.475662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-fb98a1ae-47b3-46ec-9bed-0c9ee6ca7e34 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:20.477087 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fb98a1ae-47b3-46ec-9bed-0c9ee6ca7e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:20.560508 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1338/2673] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:56:20.562742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189bb4c-1c09-43a1-afb5-bcedf8d68731 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:20.563232 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189bb4c-1c09-43a1-afb5-bcedf8d68731 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:20.563719 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a189bb4c-1c09-43a1-afb5-bcedf8d68731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:20.583870 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-a189bb4c-1c09-43a1-afb5-bcedf8d68731 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:20.586136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a189bb4c-1c09-43a1-afb5-bcedf8d68731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:20.630010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1336/2674] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:20 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:20.635118 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98a1ae-47b3-46ec-9bed-0c9ee6ca7e34 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:20.646521 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98a1ae-47b3-46ec-9bed-0c9ee6ca7e34 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:20.652471 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca02655-4683-4d59-8a9d-2bf6164ca701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:20.653367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02655-4683-4d59-8a9d-2bf6164ca701 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:20.653713 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02655-4683-4d59-8a9d-2bf6164ca701 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:20.654058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca02655-4683-4d59-8a9d-2bf6164ca701 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:20.654979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca02655-4683-4d59-8a9d-2bf6164ca701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:56:20.655322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca02655-4683-4d59-8a9d-2bf6164ca701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:20.657257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca02655-4683-4d59-8a9d-2bf6164ca701 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:20.676639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1339/2675] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:56:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:56:20.677762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189bb4c-1c09-43a1-afb5-bcedf8d68731 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:20.687184 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a189bb4c-1c09-43a1-afb5-bcedf8d68731 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:20.692109 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f01c1d-31ca-4197-87f6-76d05c257309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:20.693034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f01c1d-31ca-4197-87f6-76d05c257309 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:20.693307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f01c1d-31ca-4197-87f6-76d05c257309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:20.693576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f01c1d-31ca-4197-87f6-76d05c257309 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:20.694456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f01c1d-31ca-4197-87f6-76d05c257309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:20.696461 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f01c1d-31ca-4197-87f6-76d05c257309 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:20.733883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1337/2676] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:56:20 2021] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:56:20.735873 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca02655-4683-4d59-8a9d-2bf6164ca701 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:20.754489 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca02655-4683-4d59-8a9d-2bf6164ca701 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:20.827441 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ad0cd-2618-43b1-be20-259b18c66ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:20.828377 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ad0cd-2618-43b1-be20-259b18c66ecd admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:20.828691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ad0cd-2618-43b1-be20-259b18c66ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:20.828962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ad0cd-2618-43b1-be20-259b18c66ecd admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:20.829732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ad0cd-2618-43b1-be20-259b18c66ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:20.831661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ad0cd-2618-43b1-be20-259b18c66ecd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:20.863867 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1340/2677] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:56:20 2021] POST /identity/v3/users => generated 279 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:20.866117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f01c1d-31ca-4197-87f6-76d05c257309 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:20.877196 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f01c1d-31ca-4197-87f6-76d05c257309 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:20.894815 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efdcb0-7608-4882-b506-609e54721110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:20.895546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efdcb0-7608-4882-b506-609e54721110 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:20.895821 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efdcb0-7608-4882-b506-609e54721110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:20.896087 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efdcb0-7608-4882-b506-609e54721110 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:20.896851 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efdcb0-7608-4882-b506-609e54721110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:20.898861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efdcb0-7608-4882-b506-609e54721110 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:20.914372 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1338/2678] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:20 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:20.915995 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ad0cd-2618-43b1-be20-259b18c66ecd admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:20.927138 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ad0cd-2618-43b1-be20-259b18c66ecd admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:20.936031 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2966c90-0e2e-4479-8a2f-56dc14c046d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:20.936741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966c90-0e2e-4479-8a2f-56dc14c046d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:20.937015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966c90-0e2e-4479-8a2f-56dc14c046d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:20.937276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2966c90-0e2e-4479-8a2f-56dc14c046d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:20.938015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2966c90-0e2e-4479-8a2f-56dc14c046d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:20.939824 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2966c90-0e2e-4479-8a2f-56dc14c046d8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:20.954226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1341/2679] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:20 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:20.959016 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efdcb0-7608-4882-b506-609e54721110 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:20.971347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efdcb0-7608-4882-b506-609e54721110 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:20.977272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbebc78-954c-423b-b121-ad2053cb628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:20.978253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbebc78-954c-423b-b121-ad2053cb628e admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:20.978538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbebc78-954c-423b-b121-ad2053cb628e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:20.978813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbebc78-954c-423b-b121-ad2053cb628e admin admin] PATH_INFO: `/v3/projects/be775ba488e04be39586d8c0a305381f/users/94abad54574b4150a38c84ffe9f69296/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:20.997808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbebc78-954c-423b-b121-ad2053cb628e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be775ba488e04be39586d8c0a305381f, user_id=94abad54574b4150a38c84ffe9f69296, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:21.000538 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbebc78-954c-423b-b121-ad2053cb628e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:21.022088 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1339/2680] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:20 2021] PUT /identity/v3/projects/be775ba488e04be39586d8c0a305381f/users/94abad54574b4150a38c84ffe9f69296/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:56:21.033670 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be802f-a15a-4a2b-9c22-cb8443d9d1eb None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:21.034386 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be802f-a15a-4a2b-9c22-cb8443d9d1eb None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:21.034769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be802f-a15a-4a2b-9c22-cb8443d9d1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:21.067591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-99be802f-a15a-4a2b-9c22-cb8443d9d1eb None None] MFA Rules not processed for user `94abad54574b4150a38c84ffe9f69296`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:21.068929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-99be802f-a15a-4a2b-9c22-cb8443d9d1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:21.167531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1342/2681] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:21 2021] POST /identity/v3/auth/tokens => generated 3224 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:21.171430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbebc78-954c-423b-b121-ad2053cb628e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:21.247505 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbebc78-954c-423b-b121-ad2053cb628e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:21.252500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8d633-ead1-49f4-bab0-4ec71ed4e1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:21.253259 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8d633-ead1-49f4-bab0-4ec71ed4e1ee admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:21.253673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8d633-ead1-49f4-bab0-4ec71ed4e1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:21.254027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f8d633-ead1-49f4-bab0-4ec71ed4e1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:21.254816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8d633-ead1-49f4-bab0-4ec71ed4e1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:21.256984 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f8d633-ead1-49f4-bab0-4ec71ed4e1ee admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:21.290152 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1340/2682] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:56:21 2021] POST /identity/v3/projects => generated 355 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:56:21.294112 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be802f-a15a-4a2b-9c22-cb8443d9d1eb None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:21.305793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be802f-a15a-4a2b-9c22-cb8443d9d1eb None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:21.378214 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a07a6-7cb5-4fff-823a-d0172bdd0f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:21.378945 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a07a6-7cb5-4fff-823a-d0172bdd0f6b admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:21.379224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a07a6-7cb5-4fff-823a-d0172bdd0f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:21.379488 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a07a6-7cb5-4fff-823a-d0172bdd0f6b admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:21.380423 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a07a6-7cb5-4fff-823a-d0172bdd0f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:21.382402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a07a6-7cb5-4fff-823a-d0172bdd0f6b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:21.410392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1343/2683] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:56:21 2021] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:21.412682 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8d633-ead1-49f4-bab0-4ec71ed4e1ee admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:21.424684 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f8d633-ead1-49f4-bab0-4ec71ed4e1ee admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:21.431296 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0644c6-3aec-4dbf-b42f-a249b0b795f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:21.432376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0644c6-3aec-4dbf-b42f-a249b0b795f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:21.432933 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0644c6-3aec-4dbf-b42f-a249b0b795f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:21.433430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0644c6-3aec-4dbf-b42f-a249b0b795f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:21.434512 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0644c6-3aec-4dbf-b42f-a249b0b795f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:21.436482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0644c6-3aec-4dbf-b42f-a249b0b795f0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:21.449764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1341/2684] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:21 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:56:21.454499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a07a6-7cb5-4fff-823a-d0172bdd0f6b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:21.467427 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a07a6-7cb5-4fff-823a-d0172bdd0f6b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:21.473884 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7eff-55e4-4337-905c-7ccfde55dcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:21.474140 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7eff-55e4-4337-905c-7ccfde55dcf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:21.474416 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7eff-55e4-4337-905c-7ccfde55dcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:21.474855 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7eff-55e4-4337-905c-7ccfde55dcf6 admin admin] PATH_INFO: `/v3/projects/26324ec01cea4f87948476a636b41031/users/efd9b63786964c8882aa1bd0a3a3b743/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:21.495218 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf7eff-55e4-4337-905c-7ccfde55dcf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26324ec01cea4f87948476a636b41031, user_id=efd9b63786964c8882aa1bd0a3a3b743, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:21.497993 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf7eff-55e4-4337-905c-7ccfde55dcf6 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:21.517718 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1344/2685] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:21 2021] PUT /identity/v3/projects/26324ec01cea4f87948476a636b41031/users/efd9b63786964c8882aa1bd0a3a3b743/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:56:21.521838 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0644c6-3aec-4dbf-b42f-a249b0b795f0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:21.534487 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0644c6-3aec-4dbf-b42f-a249b0b795f0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:21.601576 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eef81e-b2b8-4d02-8c60-6a94b5a65d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:21.602252 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eef81e-b2b8-4d02-8c60-6a94b5a65d5d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:21.602531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eef81e-b2b8-4d02-8c60-6a94b5a65d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:21.602803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eef81e-b2b8-4d02-8c60-6a94b5a65d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:21.603533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eef81e-b2b8-4d02-8c60-6a94b5a65d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:21.605639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eef81e-b2b8-4d02-8c60-6a94b5a65d5d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:21.618699 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1342/2686] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:21 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:56:21.623115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7eff-55e4-4337-905c-7ccfde55dcf6 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:21.634054 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7eff-55e4-4337-905c-7ccfde55dcf6 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:21.641258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455aab6-286c-459f-93c4-94601a10338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:21.642159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455aab6-286c-459f-93c4-94601a10338e admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:21.642455 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455aab6-286c-459f-93c4-94601a10338e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:21.642778 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455aab6-286c-459f-93c4-94601a10338e admin admin] PATH_INFO: `/v3/projects/26324ec01cea4f87948476a636b41031/users/efd9b63786964c8882aa1bd0a3a3b743/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:21.645073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455aab6-286c-459f-93c4-94601a10338e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26324ec01cea4f87948476a636b41031, user_id=efd9b63786964c8882aa1bd0a3a3b743, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:21.647881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455aab6-286c-459f-93c4-94601a10338e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:21.663271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1345/2687] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:21 2021] PUT /identity/v3/projects/26324ec01cea4f87948476a636b41031/users/efd9b63786964c8882aa1bd0a3a3b743/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:56:21.673584 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf83a75-8bd9-4215-8bab-3c960e2cf251 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:21.673856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf83a75-8bd9-4215-8bab-3c960e2cf251 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:21.674118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf83a75-8bd9-4215-8bab-3c960e2cf251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:21.714282 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-fdf83a75-8bd9-4215-8bab-3c960e2cf251 None None] MFA Rules not processed for user `efd9b63786964c8882aa1bd0a3a3b743`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:21.715683 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fdf83a75-8bd9-4215-8bab-3c960e2cf251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:21.797229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1343/2688] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:21 2021] POST /identity/v3/auth/tokens => generated 3289 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:56:21.810667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455aab6-286c-459f-93c4-94601a10338e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:21.812494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f455aab6-286c-459f-93c4-94601a10338e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:21.878732 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455aab6-286c-459f-93c4-94601a10338e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:21.881245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14e8b5-dc87-48c4-b215-45978a441f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:21.882192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14e8b5-dc87-48c4-b215-45978a441f8c service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:21.882574 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14e8b5-dc87-48c4-b215-45978a441f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:21.882948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14e8b5-dc87-48c4-b215-45978a441f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:21.893143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14e8b5-dc87-48c4-b215-45978a441f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:21.894719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c14e8b5-dc87-48c4-b215-45978a441f8c service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:21.905364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1346/2689] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:21 2021] GET /identity/v3/auth/tokens => generated 3289 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:56:21.991356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf83a75-8bd9-4215-8bab-3c960e2cf251 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:22.003033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf83a75-8bd9-4215-8bab-3c960e2cf251 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:22.008074 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309998b-b8d7-4e16-be86-c838171310eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:22.008905 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309998b-b8d7-4e16-be86-c838171310eb service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:22.009288 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309998b-b8d7-4e16-be86-c838171310eb service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:22.009664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309998b-b8d7-4e16-be86-c838171310eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:22.088340 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309998b-b8d7-4e16-be86-c838171310eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:22.090519 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309998b-b8d7-4e16-be86-c838171310eb service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:22.101065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1344/2690] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:21 2021] GET /identity/v3/auth/tokens => generated 3224 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:56:33.862934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8467f3-77bd-4f33-9636-98ee25cffeb0 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:33.863443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8467f3-77bd-4f33-9636-98ee25cffeb0 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:33.863443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8467f3-77bd-4f33-9636-98ee25cffeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:33.882702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-1d8467f3-77bd-4f33-9636-98ee25cffeb0 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:33.883907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1d8467f3-77bd-4f33-9636-98ee25cffeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:33.944511 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1347/2691] 10.222.0.62 () {58 vars in 967 bytes} [Mon Dec 13 16:56:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:33.960274 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309998b-b8d7-4e16-be86-c838171310eb service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:33.961806 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c309998b-b8d7-4e16-be86-c838171310eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:34.039200 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309998b-b8d7-4e16-be86-c838171310eb service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:34.045051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da4bcb-c586-49b5-b129-b31b8e81e163 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:34.045716 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da4bcb-c586-49b5-b129-b31b8e81e163 service swift] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:34.045976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da4bcb-c586-49b5-b129-b31b8e81e163 service swift] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:34.046242 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da4bcb-c586-49b5-b129-b31b8e81e163 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:34.054990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da4bcb-c586-49b5-b129-b31b8e81e163 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:34.056559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da4bcb-c586-49b5-b129-b31b8e81e163 service swift] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:34.064431 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1345/2692] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:56:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:56:36.063552 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8467f3-77bd-4f33-9636-98ee25cffeb0 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:36.065490 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1d8467f3-77bd-4f33-9636-98ee25cffeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:36.143253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8467f3-77bd-4f33-9636-98ee25cffeb0 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:36.148875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef414e-ded9-4bc3-8927-bb2d90e1ef18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:36.149805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef414e-ded9-4bc3-8927-bb2d90e1ef18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:36.150071 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef414e-ded9-4bc3-8927-bb2d90e1ef18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:36.150342 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef414e-ded9-4bc3-8927-bb2d90e1ef18 admin admin] PATH_INFO: `/v3/users/8501035d3f3c4a46a05b72b8234befac` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:36.151676 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef414e-ded9-4bc3-8927-bb2d90e1ef18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8501035d3f3c4a46a05b72b8234befac)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:36.153654 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef414e-ded9-4bc3-8927-bb2d90e1ef18 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:36.203316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-23ef414e-ded9-4bc3-8927-bb2d90e1ef18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8501035d3f3c4a46a05b72b8234befac'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:36.216001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-23ef414e-ded9-4bc3-8927-bb2d90e1ef18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8501035d3f3c4a46a05b72b8234befac'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:36.218756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-23ef414e-ded9-4bc3-8927-bb2d90e1ef18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8501035d3f3c4a46a05b72b8234befac'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:36.225839 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-23ef414e-ded9-4bc3-8927-bb2d90e1ef18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8501035d3f3c4a46a05b72b8234befac'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:36.234965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-23ef414e-ded9-4bc3-8927-bb2d90e1ef18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8501035d3f3c4a46a05b72b8234befac'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:36.240960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1348/2693] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:56:36 2021] DELETE /identity/v3/users/8501035d3f3c4a46a05b72b8234befac => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:36.426250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da4bcb-c586-49b5-b129-b31b8e81e163 service swift] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:36.437291 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da4bcb-c586-49b5-b129-b31b8e81e163 service swift] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:36.497741 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:36.498660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:36.498939 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:36.499242 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] PATH_INFO: `/v3/projects/c2c012e0f9a44258850f7026e65a6ec2` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:36.500587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2c012e0f9a44258850f7026e65a6ec2)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:36.502715 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:36.553590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2c012e0f9a44258850f7026e65a6ec2', 'request_id': 'req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:36.562557 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2c012e0f9a44258850f7026e65a6ec2', 'request_id': 'req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:36.569219 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2c012e0f9a44258850f7026e65a6ec2', 'request_id': 'req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:36.580153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] The token cache is being invalidate because project c2c012e0f9a44258850f7026e65a6ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:56:36.580426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:36.581101 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c3cfc95d-51c9-46c0-92bb-93f96c5fdb96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:36.582710 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1346/2694] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:56:36 2021] DELETE /identity/v3/projects/c2c012e0f9a44258850f7026e65a6ec2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:36.591241 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf577d-83da-4f74-b431-f609b3464239 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:36.591535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf577d-83da-4f74-b431-f609b3464239 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:36.591819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf577d-83da-4f74-b431-f609b3464239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:36.616256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-6ebf577d-83da-4f74-b431-f609b3464239 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:36.617840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6ebf577d-83da-4f74-b431-f609b3464239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:36.683508 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1349/2695] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:36.692724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bafb8-0bc5-4206-857a-570a49149179 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:36.693136 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bafb8-0bc5-4206-857a-570a49149179 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:36.693410 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bafb8-0bc5-4206-857a-570a49149179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:36.712660 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-878bafb8-0bc5-4206-857a-570a49149179 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:36.713907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-878bafb8-0bc5-4206-857a-570a49149179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:36.722851 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1347/2696] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:36.727502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf577d-83da-4f74-b431-f609b3464239 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:36.737611 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf577d-83da-4f74-b431-f609b3464239 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:36.743411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7178555-daa1-4647-b985-15b440cf63ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:36.744073 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7178555-daa1-4647-b985-15b440cf63ed admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:36.744308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7178555-daa1-4647-b985-15b440cf63ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:36.744617 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7178555-daa1-4647-b985-15b440cf63ed admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:36.745376 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7178555-daa1-4647-b985-15b440cf63ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:56:36.745685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7178555-daa1-4647-b985-15b440cf63ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:36.747294 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7178555-daa1-4647-b985-15b440cf63ed admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:36.759807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1350/2697] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:56:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:56:36.764265 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bafb8-0bc5-4206-857a-570a49149179 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:36.774180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bafb8-0bc5-4206-857a-570a49149179 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:36.779989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54e21a-97ed-4cd3-95c4-df1671c2b767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:36.780718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54e21a-97ed-4cd3-95c4-df1671c2b767 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:36.780995 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54e21a-97ed-4cd3-95c4-df1671c2b767 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:36.781266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54e21a-97ed-4cd3-95c4-df1671c2b767 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:36.781969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54e21a-97ed-4cd3-95c4-df1671c2b767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:36.783886 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54e21a-97ed-4cd3-95c4-df1671c2b767 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:36.812356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1348/2698] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:56:36 2021] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:36.816814 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7178555-daa1-4647-b985-15b440cf63ed admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:36.827487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7178555-daa1-4647-b985-15b440cf63ed admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:36.891532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86f62b-fce4-495d-8840-3a83b1bfcfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:36.892228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86f62b-fce4-495d-8840-3a83b1bfcfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:36.892501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86f62b-fce4-495d-8840-3a83b1bfcfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:36.892791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86f62b-fce4-495d-8840-3a83b1bfcfb4 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:36.893469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86f62b-fce4-495d-8840-3a83b1bfcfb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:36.895369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86f62b-fce4-495d-8840-3a83b1bfcfb4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:36.922465 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1351/2699] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:56:36 2021] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:56:36.927554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54e21a-97ed-4cd3-95c4-df1671c2b767 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:36.939443 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54e21a-97ed-4cd3-95c4-df1671c2b767 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:36.945794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0170a97-463b-4fd9-a42a-fe58652297c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:36.946392 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0170a97-463b-4fd9-a42a-fe58652297c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:36.946667 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0170a97-463b-4fd9-a42a-fe58652297c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:36.946960 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0170a97-463b-4fd9-a42a-fe58652297c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:36.947689 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0170a97-463b-4fd9-a42a-fe58652297c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:36.949338 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0170a97-463b-4fd9-a42a-fe58652297c1 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:36.961118 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1349/2700] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:36 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:36.967680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86f62b-fce4-495d-8840-3a83b1bfcfb4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:36.982567 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86f62b-fce4-495d-8840-3a83b1bfcfb4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:36.987806 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc8294-8f94-466b-a8ff-29bbc07344d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:36.988482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc8294-8f94-466b-a8ff-29bbc07344d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:36.989011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc8294-8f94-466b-a8ff-29bbc07344d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:36.989011 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc8294-8f94-466b-a8ff-29bbc07344d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:36.989784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc8294-8f94-466b-a8ff-29bbc07344d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:36.991468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc8294-8f94-466b-a8ff-29bbc07344d8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:37.001522 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1352/2701] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:36 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:37.005742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0170a97-463b-4fd9-a42a-fe58652297c1 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:37.016481 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0170a97-463b-4fd9-a42a-fe58652297c1 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:37.022249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a6297-dba3-42aa-a843-b1d4899628d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:37.023634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a6297-dba3-42aa-a843-b1d4899628d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:37.023926 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a6297-dba3-42aa-a843-b1d4899628d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:37.024198 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a6297-dba3-42aa-a843-b1d4899628d3 admin admin] PATH_INFO: `/v3/projects/a17cfb32dc2b4830a07073b1bb4f821e/users/9305e888877a4b799a83a512007958ab/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:37.040065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a6297-dba3-42aa-a843-b1d4899628d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17cfb32dc2b4830a07073b1bb4f821e, user_id=9305e888877a4b799a83a512007958ab, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:37.042742 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a6297-dba3-42aa-a843-b1d4899628d3 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:37.057724 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1350/2702] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:37 2021] PUT /identity/v3/projects/a17cfb32dc2b4830a07073b1bb4f821e/users/9305e888877a4b799a83a512007958ab/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:37.063107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9803d-a983-4f70-9cca-1dbddfaae24a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:37.063393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9803d-a983-4f70-9cca-1dbddfaae24a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:37.063684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9803d-a983-4f70-9cca-1dbddfaae24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:37.082769 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-1df9803d-a983-4f70-9cca-1dbddfaae24a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:37.083964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1df9803d-a983-4f70-9cca-1dbddfaae24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:37.158984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1353/2703] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:56:37.171286 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a6297-dba3-42aa-a843-b1d4899628d3 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:37.174610 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-744a6297-dba3-42aa-a843-b1d4899628d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:37.239292 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a6297-dba3-42aa-a843-b1d4899628d3 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:37.244640 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aeb625-5b48-4d85-9b48-49604309ffba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:37.245278 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeb625-5b48-4d85-9b48-49604309ffba service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:37.245572 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeb625-5b48-4d85-9b48-49604309ffba service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:37.245823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aeb625-5b48-4d85-9b48-49604309ffba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:37.258014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aeb625-5b48-4d85-9b48-49604309ffba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:37.259608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aeb625-5b48-4d85-9b48-49604309ffba service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:37.269142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1351/2704] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:56:37.673948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9803d-a983-4f70-9cca-1dbddfaae24a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:37.675890 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-1df9803d-a983-4f70-9cca-1dbddfaae24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:37.702685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9803d-a983-4f70-9cca-1dbddfaae24a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:37.707782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:37.708694 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:37.708962 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:37.709230 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] PATH_INFO: `/v3/users/94abad54574b4150a38c84ffe9f69296` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:37.710600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=94abad54574b4150a38c84ffe9f69296)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:37.712657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:37.765390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94abad54574b4150a38c84ffe9f69296'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:37.779193 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94abad54574b4150a38c84ffe9f69296'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:37.780342 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94abad54574b4150a38c84ffe9f69296'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:37.789251 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94abad54574b4150a38c84ffe9f69296'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:37.798090 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94abad54574b4150a38c84ffe9f69296'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:37.804470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1354/2705] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:56:37 2021] DELETE /identity/v3/users/94abad54574b4150a38c84ffe9f69296 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:37.810027 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951edf49-0bb8-499d-bb74-4271eecd19d4 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:37.810578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951edf49-0bb8-499d-bb74-4271eecd19d4 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:37.810578 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951edf49-0bb8-499d-bb74-4271eecd19d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:37.835872 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-951edf49-0bb8-499d-bb74-4271eecd19d4 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:37.837017 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-951edf49-0bb8-499d-bb74-4271eecd19d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:37.919253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1352/2706] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:56:37.930917 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:37.932784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:38.009282 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da46f29-8e14-4779-a7a1-7937a65e3d2b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:38.013976 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab550319-0643-4e4e-8cd3-740e6bdb31f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:38.014728 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab550319-0643-4e4e-8cd3-740e6bdb31f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:38.015007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab550319-0643-4e4e-8cd3-740e6bdb31f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:38.015660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab550319-0643-4e4e-8cd3-740e6bdb31f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:38.031916 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab550319-0643-4e4e-8cd3-740e6bdb31f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:38.033736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab550319-0643-4e4e-8cd3-740e6bdb31f9 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:38.047494 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1355/2707] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:56:38.397398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951edf49-0bb8-499d-bb74-4271eecd19d4 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:38.399338 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-951edf49-0bb8-499d-bb74-4271eecd19d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:38.417989 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951edf49-0bb8-499d-bb74-4271eecd19d4 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:38.427522 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:38.428811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:38.429764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:38.431896 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] PATH_INFO: `/v3/projects/be775ba488e04be39586d8c0a305381f` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:38.442600 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be775ba488e04be39586d8c0a305381f)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:38.446233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:38.524636 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be775ba488e04be39586d8c0a305381f', 'request_id': 'req-366764fe-b31c-4d40-b48b-373d2829b41f'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:38.535181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be775ba488e04be39586d8c0a305381f', 'request_id': 'req-366764fe-b31c-4d40-b48b-373d2829b41f'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:38.543698 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be775ba488e04be39586d8c0a305381f', 'request_id': 'req-366764fe-b31c-4d40-b48b-373d2829b41f'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:38.557270 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] The token cache is being invalidate because project be775ba488e04be39586d8c0a305381f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:56:38.557680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:38.558423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:38.560301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1353/2708] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:56:38 2021] DELETE /identity/v3/projects/be775ba488e04be39586d8c0a305381f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:38.564070 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab550319-0643-4e4e-8cd3-740e6bdb31f9 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:38.573939 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab550319-0643-4e4e-8cd3-740e6bdb31f9 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:38.633812 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a52f0-4936-411d-8920-29b3328837d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:38.634900 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a52f0-4936-411d-8920-29b3328837d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:38.635373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a52f0-4936-411d-8920-29b3328837d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:38.635808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a52f0-4936-411d-8920-29b3328837d3 admin admin] PATH_INFO: `/v3/users/efd9b63786964c8882aa1bd0a3a3b743` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:38.637183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a52f0-4936-411d-8920-29b3328837d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd9b63786964c8882aa1bd0a3a3b743)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:38.639115 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a52f0-4936-411d-8920-29b3328837d3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:38.691601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ae0a52f0-4936-411d-8920-29b3328837d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd9b63786964c8882aa1bd0a3a3b743'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:38.707771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ae0a52f0-4936-411d-8920-29b3328837d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd9b63786964c8882aa1bd0a3a3b743'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:38.708860 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ae0a52f0-4936-411d-8920-29b3328837d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd9b63786964c8882aa1bd0a3a3b743'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:38.717283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ae0a52f0-4936-411d-8920-29b3328837d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd9b63786964c8882aa1bd0a3a3b743'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:38.729440 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ae0a52f0-4936-411d-8920-29b3328837d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd9b63786964c8882aa1bd0a3a3b743'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:38.737485 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1356/2709] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:56:38 2021] DELETE /identity/v3/users/efd9b63786964c8882aa1bd0a3a3b743 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:39.043851 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:39.046030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:39.067190 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366764fe-b31c-4d40-b48b-373d2829b41f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:39.165824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:39.167024 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:39.167467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:39.167736 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] PATH_INFO: `/v3/projects/26324ec01cea4f87948476a636b41031` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:39.169028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26324ec01cea4f87948476a636b41031)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:39.170949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:39.225910 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26324ec01cea4f87948476a636b41031', 'request_id': 'req-725603c5-9913-4491-8e4d-c81c11dcee31'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:39.236311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26324ec01cea4f87948476a636b41031', 'request_id': 'req-725603c5-9913-4491-8e4d-c81c11dcee31'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:39.244847 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26324ec01cea4f87948476a636b41031', 'request_id': 'req-725603c5-9913-4491-8e4d-c81c11dcee31'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:39.257383 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] The token cache is being invalidate because project 26324ec01cea4f87948476a636b41031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:56:39.257670 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:39.258722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-725603c5-9913-4491-8e4d-c81c11dcee31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:39.260533 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1354/2710] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:56:39 2021] DELETE /identity/v3/projects/26324ec01cea4f87948476a636b41031 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:39.266256 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2eba0-0ea5-4f62-9daa-64b2e0d51e46 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:39.266624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2eba0-0ea5-4f62-9daa-64b2e0d51e46 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:39.266969 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2eba0-0ea5-4f62-9daa-64b2e0d51e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:39.287269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-cad2eba0-0ea5-4f62-9daa-64b2e0d51e46 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:39.288805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cad2eba0-0ea5-4f62-9daa-64b2e0d51e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:39.352687 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1357/2711] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:39.361030 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0de35-0b94-4fba-9b33-3ac1dacfc568 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:39.361317 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0de35-0b94-4fba-9b33-3ac1dacfc568 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:39.361602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0de35-0b94-4fba-9b33-3ac1dacfc568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:39.380527 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-b4d0de35-0b94-4fba-9b33-3ac1dacfc568 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:39.381822 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b4d0de35-0b94-4fba-9b33-3ac1dacfc568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:39.390625 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1355/2712] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:39.395104 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2eba0-0ea5-4f62-9daa-64b2e0d51e46 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:39.409245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2eba0-0ea5-4f62-9daa-64b2e0d51e46 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:39.415563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf91b0-a53c-4797-9c8c-44eea7618bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:39.416349 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf91b0-a53c-4797-9c8c-44eea7618bdc admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:39.416770 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf91b0-a53c-4797-9c8c-44eea7618bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:39.417690 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf91b0-a53c-4797-9c8c-44eea7618bdc admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:39.418076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf91b0-a53c-4797-9c8c-44eea7618bdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:56:39.418458 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf91b0-a53c-4797-9c8c-44eea7618bdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:39.420099 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf91b0-a53c-4797-9c8c-44eea7618bdc admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:39.433920 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1358/2713] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:56:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:56:39.439957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0de35-0b94-4fba-9b33-3ac1dacfc568 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:39.450466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0de35-0b94-4fba-9b33-3ac1dacfc568 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:39.455652 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d41b-1790-4eb3-ba8f-a060a932c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:39.456342 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d41b-1790-4eb3-ba8f-a060a932c68a admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:39.456654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d41b-1790-4eb3-ba8f-a060a932c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:39.456919 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d41b-1790-4eb3-ba8f-a060a932c68a admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:39.457630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197d41b-1790-4eb3-ba8f-a060a932c68a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:39.459525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197d41b-1790-4eb3-ba8f-a060a932c68a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:39.492663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1356/2714] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:56:39 2021] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:39.494224 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf91b0-a53c-4797-9c8c-44eea7618bdc admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:39.507786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf91b0-a53c-4797-9c8c-44eea7618bdc admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:39.581744 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eadaaa-df45-4714-b14b-856c7716c4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:39.583275 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eadaaa-df45-4714-b14b-856c7716c4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:39.583996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eadaaa-df45-4714-b14b-856c7716c4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:39.584422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eadaaa-df45-4714-b14b-856c7716c4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:39.585312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eadaaa-df45-4714-b14b-856c7716c4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:39.587989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eadaaa-df45-4714-b14b-856c7716c4b7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:39.616748 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1359/2715] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:56:39 2021] POST /identity/v3/users => generated 282 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:39.620680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d41b-1790-4eb3-ba8f-a060a932c68a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:39.633242 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d41b-1790-4eb3-ba8f-a060a932c68a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:39.646278 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5e019-ad3b-41e0-87c2-5c4fef6b1412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:39.646994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5e019-ad3b-41e0-87c2-5c4fef6b1412 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:39.647250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5e019-ad3b-41e0-87c2-5c4fef6b1412 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:39.647819 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c5e019-ad3b-41e0-87c2-5c4fef6b1412 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:39.648686 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5e019-ad3b-41e0-87c2-5c4fef6b1412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:39.650552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c5e019-ad3b-41e0-87c2-5c4fef6b1412 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:39.665604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1357/2716] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:39 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:39.667013 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eadaaa-df45-4714-b14b-856c7716c4b7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:39.678919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eadaaa-df45-4714-b14b-856c7716c4b7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:39.684819 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6cfbb-8bdc-4742-ada4-a9746fcc7c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:39.685749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cfbb-8bdc-4742-ada4-a9746fcc7c99 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:39.686259 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cfbb-8bdc-4742-ada4-a9746fcc7c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:39.686747 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6cfbb-8bdc-4742-ada4-a9746fcc7c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:39.687807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6cfbb-8bdc-4742-ada4-a9746fcc7c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:39.689702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a6cfbb-8bdc-4742-ada4-a9746fcc7c99 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:39.708231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1360/2717] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:39 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:39.711883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5e019-ad3b-41e0-87c2-5c4fef6b1412 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:39.725343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c5e019-ad3b-41e0-87c2-5c4fef6b1412 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:39.749405 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb25445-407c-42ee-9961-8016380821b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:39.750341 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb25445-407c-42ee-9961-8016380821b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:39.750633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb25445-407c-42ee-9961-8016380821b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:39.750911 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb25445-407c-42ee-9961-8016380821b5 admin admin] PATH_INFO: `/v3/projects/3c2b225a5bd44299a0cf579d6f5d9624/users/d52f41ae5c1c4f3680663244e65bc6fa/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:39.784672 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb25445-407c-42ee-9961-8016380821b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2b225a5bd44299a0cf579d6f5d9624, user_id=d52f41ae5c1c4f3680663244e65bc6fa, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:39.788812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb25445-407c-42ee-9961-8016380821b5 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:39.812428 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1358/2718] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:39 2021] PUT /identity/v3/projects/3c2b225a5bd44299a0cf579d6f5d9624/users/d52f41ae5c1c4f3680663244e65bc6fa/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:39.823362 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eff93b-b6cc-4ec4-b959-193a6a09315d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:39.823791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eff93b-b6cc-4ec4-b959-193a6a09315d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:39.824147 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eff93b-b6cc-4ec4-b959-193a6a09315d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:39.875234 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e1eff93b-b6cc-4ec4-b959-193a6a09315d None None] MFA Rules not processed for user `d52f41ae5c1c4f3680663244e65bc6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:39.876834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e1eff93b-b6cc-4ec4-b959-193a6a09315d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:39.964944 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb25445-407c-42ee-9961-8016380821b5 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:39.967191 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1361/2719] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:39 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:40.052990 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb25445-407c-42ee-9961-8016380821b5 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:40.058014 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1a895-5ff4-4d61-90d5-c1099e7fb1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:40.058673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1a895-5ff4-4d61-90d5-c1099e7fb1d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:40.058954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1a895-5ff4-4d61-90d5-c1099e7fb1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:40.059227 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1a895-5ff4-4d61-90d5-c1099e7fb1d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:40.059929 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1a895-5ff4-4d61-90d5-c1099e7fb1d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:40.061864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1a895-5ff4-4d61-90d5-c1099e7fb1d7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:40.092496 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1359/2720] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:56:39 2021] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:40.093991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eff93b-b6cc-4ec4-b959-193a6a09315d None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:40.107930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eff93b-b6cc-4ec4-b959-193a6a09315d None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:40.177043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a21aeb-2aa2-4e3e-abba-8d3fc69620eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:40.178191 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a21aeb-2aa2-4e3e-abba-8d3fc69620eb admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:40.178474 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a21aeb-2aa2-4e3e-abba-8d3fc69620eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:40.178742 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a21aeb-2aa2-4e3e-abba-8d3fc69620eb admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:40.179464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a21aeb-2aa2-4e3e-abba-8d3fc69620eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:40.182200 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a21aeb-2aa2-4e3e-abba-8d3fc69620eb admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:40.204660 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1362/2721] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:56:40 2021] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:40.208463 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1a895-5ff4-4d61-90d5-c1099e7fb1d7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:40.219166 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1a895-5ff4-4d61-90d5-c1099e7fb1d7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:40.225001 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e00b7-dadc-44cf-9bb3-0f28418d4928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:40.227018 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e00b7-dadc-44cf-9bb3-0f28418d4928 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:40.227297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e00b7-dadc-44cf-9bb3-0f28418d4928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:40.227567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e00b7-dadc-44cf-9bb3-0f28418d4928 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:40.228609 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e00b7-dadc-44cf-9bb3-0f28418d4928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:40.230536 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e00b7-dadc-44cf-9bb3-0f28418d4928 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:40.245109 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1360/2722] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:40 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:40.250239 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a21aeb-2aa2-4e3e-abba-8d3fc69620eb admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:40.264888 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a21aeb-2aa2-4e3e-abba-8d3fc69620eb admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:40.270952 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a855ecd-b556-45ea-a10e-99a51ecf4f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:40.274566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a855ecd-b556-45ea-a10e-99a51ecf4f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:40.274566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a855ecd-b556-45ea-a10e-99a51ecf4f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:40.274566 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a855ecd-b556-45ea-a10e-99a51ecf4f35 admin admin] PATH_INFO: `/v3/projects/4ade376941d74b63b566ea008d8acf6c/users/2f8c44976a4741d1affc345e7a3dfcd0/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:40.296908 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a855ecd-b556-45ea-a10e-99a51ecf4f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ade376941d74b63b566ea008d8acf6c, user_id=2f8c44976a4741d1affc345e7a3dfcd0, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:40.299701 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a855ecd-b556-45ea-a10e-99a51ecf4f35 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:40.319260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1363/2723] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:40 2021] PUT /identity/v3/projects/4ade376941d74b63b566ea008d8acf6c/users/2f8c44976a4741d1affc345e7a3dfcd0/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:56:40.323881 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e00b7-dadc-44cf-9bb3-0f28418d4928 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:40.340125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e00b7-dadc-44cf-9bb3-0f28418d4928 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:40.419183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a9ef9-cdc5-4a48-afac-8169b90ff520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:40.420475 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9ef9-cdc5-4a48-afac-8169b90ff520 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:40.421025 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9ef9-cdc5-4a48-afac-8169b90ff520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:40.421523 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9ef9-cdc5-4a48-afac-8169b90ff520 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:40.422590 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a9ef9-cdc5-4a48-afac-8169b90ff520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:40.424735 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4a9ef9-cdc5-4a48-afac-8169b90ff520 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:40.443986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1361/2724] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:40 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:40.445372 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a855ecd-b556-45ea-a10e-99a51ecf4f35 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:40.457076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a855ecd-b556-45ea-a10e-99a51ecf4f35 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:40.463369 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b121ef-bc6d-4529-9e33-d1df31603d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:40.464344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b121ef-bc6d-4529-9e33-d1df31603d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:40.464808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b121ef-bc6d-4529-9e33-d1df31603d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:40.464998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b121ef-bc6d-4529-9e33-d1df31603d26 admin admin] PATH_INFO: `/v3/projects/4ade376941d74b63b566ea008d8acf6c/users/2f8c44976a4741d1affc345e7a3dfcd0/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:40.468183 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b121ef-bc6d-4529-9e33-d1df31603d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ade376941d74b63b566ea008d8acf6c, user_id=2f8c44976a4741d1affc345e7a3dfcd0, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:40.471032 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b121ef-bc6d-4529-9e33-d1df31603d26 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:40.484343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1364/2725] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:40 2021] PUT /identity/v3/projects/4ade376941d74b63b566ea008d8acf6c/users/2f8c44976a4741d1affc345e7a3dfcd0/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:40.497142 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ffdd-5d4c-47a4-ac78-3be4b254563d None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:40.497426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ffdd-5d4c-47a4-ac78-3be4b254563d None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:40.497704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ffdd-5d4c-47a4-ac78-3be4b254563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:40.532893 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-fab8ffdd-5d4c-47a4-ac78-3be4b254563d None None] MFA Rules not processed for user `2f8c44976a4741d1affc345e7a3dfcd0`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:40.534295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fab8ffdd-5d4c-47a4-ac78-3be4b254563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:40.622395 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1362/2726] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:40 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:40.633813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b121ef-bc6d-4529-9e33-d1df31603d26 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:40.635810 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-31b121ef-bc6d-4529-9e33-d1df31603d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:40.704237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b121ef-bc6d-4529-9e33-d1df31603d26 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:40.708717 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906ef7a-d01b-4379-b3d0-225064225620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:40.712056 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906ef7a-d01b-4379-b3d0-225064225620 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:40.712364 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906ef7a-d01b-4379-b3d0-225064225620 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:40.712663 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906ef7a-d01b-4379-b3d0-225064225620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:40.722991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906ef7a-d01b-4379-b3d0-225064225620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:40.724809 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906ef7a-d01b-4379-b3d0-225064225620 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:40.735238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1365/2727] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:40 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:56:40.812676 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8ffdd-5d4c-47a4-ac78-3be4b254563d None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:40.823331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8ffdd-5d4c-47a4-ac78-3be4b254563d None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:40.827712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255ce4f-1ea1-4c4f-8d66-a27761ed174f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:40.828535 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255ce4f-1ea1-4c4f-8d66-a27761ed174f service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:40.828840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255ce4f-1ea1-4c4f-8d66-a27761ed174f service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:40.829158 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255ce4f-1ea1-4c4f-8d66-a27761ed174f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:40.890507 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255ce4f-1ea1-4c4f-8d66-a27761ed174f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:40.892084 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255ce4f-1ea1-4c4f-8d66-a27761ed174f service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:40.904060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1363/2728] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:40 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:56:41.832004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4bc0-437f-4bbf-88ca-9ed6657ea438 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:41.832524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4bc0-437f-4bbf-88ca-9ed6657ea438 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:41.832741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e4bc0-437f-4bbf-88ca-9ed6657ea438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:41.863109 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-554e4bc0-437f-4bbf-88ca-9ed6657ea438 None None] MFA Rules not processed for user `9305e888877a4b799a83a512007958ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:41.864481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-554e4bc0-437f-4bbf-88ca-9ed6657ea438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:41.948251 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1366/2729] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:41 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:41.950817 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255ce4f-1ea1-4c4f-8d66-a27761ed174f service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:41.953853 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b255ce4f-1ea1-4c4f-8d66-a27761ed174f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:42.026168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255ce4f-1ea1-4c4f-8d66-a27761ed174f service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:42.030594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0391357-8dcc-40fd-8e79-021236bc2247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:42.031408 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0391357-8dcc-40fd-8e79-021236bc2247 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:42.031692 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0391357-8dcc-40fd-8e79-021236bc2247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:42.031964 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0391357-8dcc-40fd-8e79-021236bc2247 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:42.032858 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0391357-8dcc-40fd-8e79-021236bc2247 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:42.034994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0391357-8dcc-40fd-8e79-021236bc2247 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:42.068055 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1364/2730] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:56:41 2021] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:42.068497 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e4bc0-437f-4bbf-88ca-9ed6657ea438 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:42.080088 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e4bc0-437f-4bbf-88ca-9ed6657ea438 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:42.143594 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b4009-cdd2-4c32-b141-7c5301cace1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:42.144420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b4009-cdd2-4c32-b141-7c5301cace1c admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:42.144790 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b4009-cdd2-4c32-b141-7c5301cace1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:42.145129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b4009-cdd2-4c32-b141-7c5301cace1c admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:42.145846 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b4009-cdd2-4c32-b141-7c5301cace1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:42.147923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b4009-cdd2-4c32-b141-7c5301cace1c admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:42.172402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1367/2731] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:56:42 2021] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:56:42.177713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0391357-8dcc-40fd-8e79-021236bc2247 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:42.193938 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0391357-8dcc-40fd-8e79-021236bc2247 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:42.198740 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1efdfe-e5aa-4dd6-85cf-5b3221ae13c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:42.199425 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efdfe-e5aa-4dd6-85cf-5b3221ae13c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:42.199811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efdfe-e5aa-4dd6-85cf-5b3221ae13c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:42.199975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1efdfe-e5aa-4dd6-85cf-5b3221ae13c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:42.200798 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1efdfe-e5aa-4dd6-85cf-5b3221ae13c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:42.203382 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1efdfe-e5aa-4dd6-85cf-5b3221ae13c9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:42.221037 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b4009-cdd2-4c32-b141-7c5301cace1c admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:42.221457 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1365/2732] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:42 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:56:42.232200 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b4009-cdd2-4c32-b141-7c5301cace1c admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:42.237101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb7c53-aca9-49ce-9ee0-7b0bbf25d3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:42.238005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb7c53-aca9-49ce-9ee0-7b0bbf25d3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:42.238305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb7c53-aca9-49ce-9ee0-7b0bbf25d3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:42.238680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb7c53-aca9-49ce-9ee0-7b0bbf25d3c2 admin admin] PATH_INFO: `/v3/projects/cabe7ad06f134bc380218a457a669798/users/1fa841988d2d4f44b9d4832f3cbd7a6c/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:42.259156 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb7c53-aca9-49ce-9ee0-7b0bbf25d3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cabe7ad06f134bc380218a457a669798, user_id=1fa841988d2d4f44b9d4832f3cbd7a6c, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:42.261934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb7c53-aca9-49ce-9ee0-7b0bbf25d3c2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:42.279726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1368/2733] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:42 2021] PUT /identity/v3/projects/cabe7ad06f134bc380218a457a669798/users/1fa841988d2d4f44b9d4832f3cbd7a6c/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:42.283770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1efdfe-e5aa-4dd6-85cf-5b3221ae13c9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:42.300639 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1efdfe-e5aa-4dd6-85cf-5b3221ae13c9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:42.376362 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e70d1-e77d-48fb-84ee-22f41a91de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:42.377195 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e70d1-e77d-48fb-84ee-22f41a91de70 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:42.377733 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e70d1-e77d-48fb-84ee-22f41a91de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:42.378054 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e70d1-e77d-48fb-84ee-22f41a91de70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:42.378927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e70d1-e77d-48fb-84ee-22f41a91de70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:42.380646 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e70d1-e77d-48fb-84ee-22f41a91de70 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:42.395143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1366/2734] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:42 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:42.396955 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb7c53-aca9-49ce-9ee0-7b0bbf25d3c2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:42.420529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb7c53-aca9-49ce-9ee0-7b0bbf25d3c2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:42.428122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b142457-266a-44e0-91ac-d63b82c1f6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:42.430683 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142457-266a-44e0-91ac-d63b82c1f6cd admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:42.431315 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142457-266a-44e0-91ac-d63b82c1f6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:42.431762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b142457-266a-44e0-91ac-d63b82c1f6cd admin admin] PATH_INFO: `/v3/projects/cabe7ad06f134bc380218a457a669798/users/1fa841988d2d4f44b9d4832f3cbd7a6c/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:42.434422 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b142457-266a-44e0-91ac-d63b82c1f6cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cabe7ad06f134bc380218a457a669798, user_id=1fa841988d2d4f44b9d4832f3cbd7a6c, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:42.437543 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b142457-266a-44e0-91ac-d63b82c1f6cd admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:42.450470 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1369/2735] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:42 2021] PUT /identity/v3/projects/cabe7ad06f134bc380218a457a669798/users/1fa841988d2d4f44b9d4832f3cbd7a6c/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:56:43.711488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e70d1-e77d-48fb-84ee-22f41a91de70 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:43.723714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e70d1-e77d-48fb-84ee-22f41a91de70 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:43.803751 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:43.805159 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:43.805159 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:43.805377 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] PATH_INFO: `/v3/users/d52f41ae5c1c4f3680663244e65bc6fa` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:43.806732 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d52f41ae5c1c4f3680663244e65bc6fa)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:43.809764 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:43.868591 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd52f41ae5c1c4f3680663244e65bc6fa'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:43.882314 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd52f41ae5c1c4f3680663244e65bc6fa'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:43.894066 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd52f41ae5c1c4f3680663244e65bc6fa'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:43.903186 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd52f41ae5c1c4f3680663244e65bc6fa'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:43.903951 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd52f41ae5c1c4f3680663244e65bc6fa'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:43.917337 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7941558-ccc1-4720-8786-cbf528a24bff None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:43.918266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7941558-ccc1-4720-8786-cbf528a24bff None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:43.918694 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7941558-ccc1-4720-8786-cbf528a24bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:43.920209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1367/2736] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:56:43 2021] DELETE /identity/v3/users/d52f41ae5c1c4f3680663244e65bc6fa => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:43.940173 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-c7941558-ccc1-4720-8786-cbf528a24bff None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:43.941702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c7941558-ccc1-4720-8786-cbf528a24bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:44.020729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1370/2737] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:43 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:44.029863 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:44.031813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:44.118549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3ecb-bb8f-4c9e-837b-2b628f31d982 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:44.122404 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0de14-91f7-4e70-acdb-2e2c210d0ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:44.123137 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0de14-91f7-4e70-acdb-2e2c210d0ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:44.123500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0de14-91f7-4e70-acdb-2e2c210d0ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:44.123830 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a0de14-91f7-4e70-acdb-2e2c210d0ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:44.137164 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0de14-91f7-4e70-acdb-2e2c210d0ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:44.138799 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a0de14-91f7-4e70-acdb-2e2c210d0ea8 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:44.154559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1368/2738] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:56:44.698368 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7941558-ccc1-4720-8786-cbf528a24bff None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:44.699882 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c7941558-ccc1-4720-8786-cbf528a24bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:44.718129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7941558-ccc1-4720-8786-cbf528a24bff None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:44.725242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:44.727148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:44.730257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:44.730699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] PATH_INFO: `/v3/projects/3c2b225a5bd44299a0cf579d6f5d9624` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:44.733169 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2b225a5bd44299a0cf579d6f5d9624)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:44.735122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:44.808348 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2b225a5bd44299a0cf579d6f5d9624', 'request_id': 'req-6567bdf3-cd04-4309-84b6-49465b307779'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:44.820275 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2b225a5bd44299a0cf579d6f5d9624', 'request_id': 'req-6567bdf3-cd04-4309-84b6-49465b307779'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:44.828541 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2b225a5bd44299a0cf579d6f5d9624', 'request_id': 'req-6567bdf3-cd04-4309-84b6-49465b307779'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:44.839921 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] The token cache is being invalidate because project 3c2b225a5bd44299a0cf579d6f5d9624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:56:44.840784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:44.841791 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:44.846809 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1371/2739] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:56:44 2021] DELETE /identity/v3/projects/3c2b225a5bd44299a0cf579d6f5d9624 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:44.847957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0de14-91f7-4e70-acdb-2e2c210d0ea8 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:44.862095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a0de14-91f7-4e70-acdb-2e2c210d0ea8 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:44.986731 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2f0c9-e4ce-4ddd-b1bd-90779ba679c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:44.987991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2f0c9-e4ce-4ddd-b1bd-90779ba679c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:44.989076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2f0c9-e4ce-4ddd-b1bd-90779ba679c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:44.989550 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2f0c9-e4ce-4ddd-b1bd-90779ba679c4 admin admin] PATH_INFO: `/v3/users/2f8c44976a4741d1affc345e7a3dfcd0` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:44.992221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2f0c9-e4ce-4ddd-b1bd-90779ba679c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8c44976a4741d1affc345e7a3dfcd0)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:44.994450 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2f0c9-e4ce-4ddd-b1bd-90779ba679c4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:45.072019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3fc2f0c9-e4ce-4ddd-b1bd-90779ba679c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8c44976a4741d1affc345e7a3dfcd0'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:45.088456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3fc2f0c9-e4ce-4ddd-b1bd-90779ba679c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8c44976a4741d1affc345e7a3dfcd0'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:45.108246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3fc2f0c9-e4ce-4ddd-b1bd-90779ba679c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8c44976a4741d1affc345e7a3dfcd0'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:45.128977 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3fc2f0c9-e4ce-4ddd-b1bd-90779ba679c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8c44976a4741d1affc345e7a3dfcd0'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:45.129747 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-3fc2f0c9-e4ce-4ddd-b1bd-90779ba679c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8c44976a4741d1affc345e7a3dfcd0'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:45.144386 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1369/2740] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:56:44 2021] DELETE /identity/v3/users/2f8c44976a4741d1affc345e7a3dfcd0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:56:45.702923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:45.705457 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:45.723198 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567bdf3-cd04-4309-84b6-49465b307779 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:45.788715 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:45.790445 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:45.791673 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:45.792192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] PATH_INFO: `/v3/projects/4ade376941d74b63b566ea008d8acf6c` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:45.793807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ade376941d74b63b566ea008d8acf6c)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:45.796278 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:45.873484 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ade376941d74b63b566ea008d8acf6c', 'request_id': 'req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:45.887645 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ade376941d74b63b566ea008d8acf6c', 'request_id': 'req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:45.895312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ade376941d74b63b566ea008d8acf6c', 'request_id': 'req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:45.915723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] The token cache is being invalidate because project 4ade376941d74b63b566ea008d8acf6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:56:45.916076 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:45.916851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-7545aee8-b02b-4c5a-ab89-f6f72e3f27b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:45.918587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1372/2741] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:56:45 2021] DELETE /identity/v3/projects/4ade376941d74b63b566ea008d8acf6c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:45.927569 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b773c-7eda-47cc-a8bf-2224cd8fb6d5 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:45.928122 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b773c-7eda-47cc-a8bf-2224cd8fb6d5 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:45.928334 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b773c-7eda-47cc-a8bf-2224cd8fb6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:45.951060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-0e9b773c-7eda-47cc-a8bf-2224cd8fb6d5 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:45.952749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-0e9b773c-7eda-47cc-a8bf-2224cd8fb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:46.055054 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1370/2742] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:46.063498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e19775-0192-4074-a99b-692b467e31cb None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:46.063789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e19775-0192-4074-a99b-692b467e31cb None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:46.064070 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e19775-0192-4074-a99b-692b467e31cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:46.097283 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-09e19775-0192-4074-a99b-692b467e31cb None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:46.103315 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-09e19775-0192-4074-a99b-692b467e31cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:46.127050 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1373/2743] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:46.131584 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b773c-7eda-47cc-a8bf-2224cd8fb6d5 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:46.147267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b773c-7eda-47cc-a8bf-2224cd8fb6d5 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:46.153234 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8e89f-9652-44c3-8d0b-45ee09ee97b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:46.153927 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8e89f-9652-44c3-8d0b-45ee09ee97b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:46.154208 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8e89f-9652-44c3-8d0b-45ee09ee97b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:46.154476 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8e89f-9652-44c3-8d0b-45ee09ee97b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:46.155226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8e89f-9652-44c3-8d0b-45ee09ee97b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:56:46.155534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8e89f-9652-44c3-8d0b-45ee09ee97b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:46.157210 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8e89f-9652-44c3-8d0b-45ee09ee97b8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:46.177161 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1371/2744] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:56:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:56:46.181568 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e19775-0192-4074-a99b-692b467e31cb None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:46.195420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e19775-0192-4074-a99b-692b467e31cb None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:46.214760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6006dc9-590b-417e-b275-34c3f877ac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:46.216326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6006dc9-590b-417e-b275-34c3f877ac0b admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:46.216693 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6006dc9-590b-417e-b275-34c3f877ac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:46.217174 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6006dc9-590b-417e-b275-34c3f877ac0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:46.217946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6006dc9-590b-417e-b275-34c3f877ac0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:46.220227 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6006dc9-590b-417e-b275-34c3f877ac0b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:46.280729 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1374/2745] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:56:46 2021] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:46.285273 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8e89f-9652-44c3-8d0b-45ee09ee97b8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:46.317063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8e89f-9652-44c3-8d0b-45ee09ee97b8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:46.434778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da0b4b-e0c1-4e32-8ef7-d54f1901d9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:46.435712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da0b4b-e0c1-4e32-8ef7-d54f1901d9cc admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:46.435712 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da0b4b-e0c1-4e32-8ef7-d54f1901d9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:46.436000 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da0b4b-e0c1-4e32-8ef7-d54f1901d9cc admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:46.436747 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da0b4b-e0c1-4e32-8ef7-d54f1901d9cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:46.438726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da0b4b-e0c1-4e32-8ef7-d54f1901d9cc admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:46.470862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1372/2746] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:56:46 2021] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:46.475357 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6006dc9-590b-417e-b275-34c3f877ac0b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:46.492822 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6006dc9-590b-417e-b275-34c3f877ac0b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:46.499687 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aed24-cc49-49d2-91f4-ec297f95f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:46.501205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aed24-cc49-49d2-91f4-ec297f95f238 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:46.501930 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aed24-cc49-49d2-91f4-ec297f95f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:46.502498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aed24-cc49-49d2-91f4-ec297f95f238 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:46.503564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aed24-cc49-49d2-91f4-ec297f95f238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:46.506750 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aed24-cc49-49d2-91f4-ec297f95f238 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:46.525143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1375/2747] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:46 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:46.528343 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da0b4b-e0c1-4e32-8ef7-d54f1901d9cc admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:46.542414 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da0b4b-e0c1-4e32-8ef7-d54f1901d9cc admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:46.548163 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5dbd0c-d772-4af7-b863-3abf940996f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:46.549295 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dbd0c-d772-4af7-b863-3abf940996f6 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:46.550073 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dbd0c-d772-4af7-b863-3abf940996f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:46.550673 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5dbd0c-d772-4af7-b863-3abf940996f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:46.551702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dbd0c-d772-4af7-b863-3abf940996f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:46.554154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5dbd0c-d772-4af7-b863-3abf940996f6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:46.568283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1373/2748] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:46 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:46.572792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aed24-cc49-49d2-91f4-ec297f95f238 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:46.584986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aed24-cc49-49d2-91f4-ec297f95f238 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:46.589960 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca843b-e88a-4b9b-b28f-a53b5cbb43a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:46.590995 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca843b-e88a-4b9b-b28f-a53b5cbb43a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:46.591414 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca843b-e88a-4b9b-b28f-a53b5cbb43a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:46.591777 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca843b-e88a-4b9b-b28f-a53b5cbb43a3 admin admin] PATH_INFO: `/v3/projects/bcd9884bbcec4ec1b470f7b42388eb6f/users/8a8a970f7ee24da5bc903d5b1660df29/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:46.612025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca843b-e88a-4b9b-b28f-a53b5cbb43a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd9884bbcec4ec1b470f7b42388eb6f, user_id=8a8a970f7ee24da5bc903d5b1660df29, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:46.615614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca843b-e88a-4b9b-b28f-a53b5cbb43a3 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:46.637603 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1376/2749] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:46 2021] PUT /identity/v3/projects/bcd9884bbcec4ec1b470f7b42388eb6f/users/8a8a970f7ee24da5bc903d5b1660df29/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:56:46.650426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775cf1f-a923-419a-8a13-8b146dce1991 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:46.651303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775cf1f-a923-419a-8a13-8b146dce1991 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:46.651674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775cf1f-a923-419a-8a13-8b146dce1991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:46.714018 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-1775cf1f-a923-419a-8a13-8b146dce1991 None None] MFA Rules not processed for user `8a8a970f7ee24da5bc903d5b1660df29`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:46.715409 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1775cf1f-a923-419a-8a13-8b146dce1991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:46.788542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1374/2750] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:46 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:46.794266 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca843b-e88a-4b9b-b28f-a53b5cbb43a3 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:46.889644 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca843b-e88a-4b9b-b28f-a53b5cbb43a3 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:46.899213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234c28-1ceb-4d29-9a9a-d12ad941edf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:46.899981 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234c28-1ceb-4d29-9a9a-d12ad941edf5 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:46.900182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234c28-1ceb-4d29-9a9a-d12ad941edf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:46.900456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234c28-1ceb-4d29-9a9a-d12ad941edf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:46.901456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d234c28-1ceb-4d29-9a9a-d12ad941edf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:46.903546 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d234c28-1ceb-4d29-9a9a-d12ad941edf5 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:46.936031 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1377/2751] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:56:46 2021] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:46.937042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775cf1f-a923-419a-8a13-8b146dce1991 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:46.952008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775cf1f-a923-419a-8a13-8b146dce1991 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.070701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6adf6c-d607-4a95-81b7-5406d7f4cd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.071612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6adf6c-d607-4a95-81b7-5406d7f4cd67 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.073212 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6adf6c-d607-4a95-81b7-5406d7f4cd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.073594 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6adf6c-d607-4a95-81b7-5406d7f4cd67 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.074411 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6adf6c-d607-4a95-81b7-5406d7f4cd67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:47.084722 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6adf6c-d607-4a95-81b7-5406d7f4cd67 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:47.116953 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1375/2752] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:56:46 2021] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:47.119915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234c28-1ceb-4d29-9a9a-d12ad941edf5 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:47.141965 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234c28-1ceb-4d29-9a9a-d12ad941edf5 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.147988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c135f-4a62-4a2c-96a1-cd2ccd7bc2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.148772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c135f-4a62-4a2c-96a1-cd2ccd7bc2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.149379 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c135f-4a62-4a2c-96a1-cd2ccd7bc2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.149723 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c135f-4a62-4a2c-96a1-cd2ccd7bc2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.151939 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c135f-4a62-4a2c-96a1-cd2ccd7bc2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:47.157528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c135f-4a62-4a2c-96a1-cd2ccd7bc2d1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:47.172685 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1378/2753] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:47 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:47.176643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6adf6c-d607-4a95-81b7-5406d7f4cd67 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:47.187090 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6adf6c-d607-4a95-81b7-5406d7f4cd67 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.194626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a8019-fb65-4d4e-a8e3-f8b1d52bc5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.195311 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a8019-fb65-4d4e-a8e3-f8b1d52bc5ed admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.195568 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a8019-fb65-4d4e-a8e3-f8b1d52bc5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.197823 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a8019-fb65-4d4e-a8e3-f8b1d52bc5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.198599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a8019-fb65-4d4e-a8e3-f8b1d52bc5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:47.200229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a8019-fb65-4d4e-a8e3-f8b1d52bc5ed admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:47.212165 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1376/2754] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:47 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:47.219008 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c135f-4a62-4a2c-96a1-cd2ccd7bc2d1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:47.219537 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30895aa-261e-44d9-b2a3-e589c08f5110 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.219829 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30895aa-261e-44d9-b2a3-e589c08f5110 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.220103 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30895aa-261e-44d9-b2a3-e589c08f5110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.246276 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c135f-4a62-4a2c-96a1-cd2ccd7bc2d1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.252265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5e075a-9c25-4e96-ab6e-00239bcb0014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.253725 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e075a-9c25-4e96-ab6e-00239bcb0014 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.254025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e075a-9c25-4e96-ab6e-00239bcb0014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.254298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5e075a-9c25-4e96-ab6e-00239bcb0014 admin admin] PATH_INFO: `/v3/projects/5563054dd16e48cb963fc18488ba3e7c/users/9677fe1c471e4905bb583afa5e0278db/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.269559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f30895aa-261e-44d9-b2a3-e589c08f5110 None None] MFA Rules not processed for user `1fa841988d2d4f44b9d4832f3cbd7a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:47.271580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f30895aa-261e-44d9-b2a3-e589c08f5110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:47.282646 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e075a-9c25-4e96-ab6e-00239bcb0014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5563054dd16e48cb963fc18488ba3e7c, user_id=9677fe1c471e4905bb583afa5e0278db, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:47.285320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5e075a-9c25-4e96-ab6e-00239bcb0014 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:47.300530 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1379/2755] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:47 2021] PUT /identity/v3/projects/5563054dd16e48cb963fc18488ba3e7c/users/9677fe1c471e4905bb583afa5e0278db/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:47.312836 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f7041-f1a2-4d68-8211-436935efe513 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.313117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f7041-f1a2-4d68-8211-436935efe513 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.313391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f7041-f1a2-4d68-8211-436935efe513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.341968 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-6b0f7041-f1a2-4d68-8211-436935efe513 None None] MFA Rules not processed for user `9677fe1c471e4905bb583afa5e0278db`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:47.343371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6b0f7041-f1a2-4d68-8211-436935efe513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:47.365954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1377/2756] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:47 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:47.384278 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30895aa-261e-44d9-b2a3-e589c08f5110 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:47.386514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f30895aa-261e-44d9-b2a3-e589c08f5110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:47.452998 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1380/2757] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:47 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:56:47.454535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f7041-f1a2-4d68-8211-436935efe513 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:47.464688 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30895aa-261e-44d9-b2a3-e589c08f5110 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.515899 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be1dcd-85d4-4eda-ad38-1e60863ac5dc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18f1422ce48e44ab85e6d5e10d1ea898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.516801 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be1dcd-85d4-4eda-ad38-1e60863ac5dc service glance] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.517218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be1dcd-85d4-4eda-ad38-1e60863ac5dc service glance] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.517608 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be1dcd-85d4-4eda-ad38-1e60863ac5dc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.520106 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-99be1dcd-85d4-4eda-ad38-1e60863ac5dc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:47.534084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f7041-f1a2-4d68-8211-436935efe513 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.540101 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba04d7-2bec-4b6b-a23f-91bcf0d7683d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.541339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba04d7-2bec-4b6b-a23f-91bcf0d7683d admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.541339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba04d7-2bec-4b6b-a23f-91bcf0d7683d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.541339 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba04d7-2bec-4b6b-a23f-91bcf0d7683d admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.542059 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba04d7-2bec-4b6b-a23f-91bcf0d7683d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:47.543996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba04d7-2bec-4b6b-a23f-91bcf0d7683d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:47.574600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1381/2758] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:56:47 2021] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:47.578753 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba04d7-2bec-4b6b-a23f-91bcf0d7683d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:47.586229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be1dcd-85d4-4eda-ad38-1e60863ac5dc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:47.587688 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be1dcd-85d4-4eda-ad38-1e60863ac5dc service glance] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:47.597514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1378/2759] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:47 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:56:47.652498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba04d7-2bec-4b6b-a23f-91bcf0d7683d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.657775 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6c281-e606-443e-8824-a1ef70c1eb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.659600 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6c281-e606-443e-8824-a1ef70c1eb9e admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.659885 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6c281-e606-443e-8824-a1ef70c1eb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.660160 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6c281-e606-443e-8824-a1ef70c1eb9e admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.661214 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6c281-e606-443e-8824-a1ef70c1eb9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:47.662862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6c281-e606-443e-8824-a1ef70c1eb9e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:47.692735 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1382/2760] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:56:47 2021] POST /identity/v3/users => generated 299 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:56:47.695467 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be1dcd-85d4-4eda-ad38-1e60863ac5dc service glance] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:47.706962 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be1dcd-85d4-4eda-ad38-1e60863ac5dc service glance] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.712365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6a467-2be4-4ffa-b79b-aef017f11b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.713373 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6a467-2be4-4ffa-b79b-aef017f11b94 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.713916 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6a467-2be4-4ffa-b79b-aef017f11b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.714189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6a467-2be4-4ffa-b79b-aef017f11b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.715567 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6a467-2be4-4ffa-b79b-aef017f11b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:47.715979 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d347a-fa97-4372-84dc-77af84a08feb None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.716631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6a467-2be4-4ffa-b79b-aef017f11b94 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:47.716742 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d347a-fa97-4372-84dc-77af84a08feb None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.717007 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d347a-fa97-4372-84dc-77af84a08feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.730892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1379/2761] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:47 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:47.731949 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6a467-2be4-4ffa-b79b-aef017f11b94 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:47.737387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-e38d347a-fa97-4372-84dc-77af84a08feb None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:47.738756 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e38d347a-fa97-4372-84dc-77af84a08feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:47.745550 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6a467-2be4-4ffa-b79b-aef017f11b94 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.750532 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db34b1b-0f13-4bd6-a8ea-06a736936f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.751546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db34b1b-0f13-4bd6-a8ea-06a736936f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.751891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db34b1b-0f13-4bd6-a8ea-06a736936f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.752229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db34b1b-0f13-4bd6-a8ea-06a736936f6b admin admin] PATH_INFO: `/v3/projects/c3c97c48fb024e25934d0e0dfd792a08/users/f68c563c821f44ffa82940a8bd592f68/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.768037 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db34b1b-0f13-4bd6-a8ea-06a736936f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c97c48fb024e25934d0e0dfd792a08, user_id=f68c563c821f44ffa82940a8bd592f68, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:47.772182 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db34b1b-0f13-4bd6-a8ea-06a736936f6b admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:47.793346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1380/2762] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:47 2021] PUT /identity/v3/projects/c3c97c48fb024e25934d0e0dfd792a08/users/f68c563c821f44ffa82940a8bd592f68/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:47.794400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db34b1b-0f13-4bd6-a8ea-06a736936f6b admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:47.800273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1383/2763] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:56:47 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:56:47.821822 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d347a-fa97-4372-84dc-77af84a08feb None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:47.823666 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e38d347a-fa97-4372-84dc-77af84a08feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:47.872633 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db34b1b-0f13-4bd6-a8ea-06a736936f6b admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.877700 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0ee21-914d-4ea7-9e36-64fccf15c98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.878329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0ee21-914d-4ea7-9e36-64fccf15c98d admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.878605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0ee21-914d-4ea7-9e36-64fccf15c98d admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.878875 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0ee21-914d-4ea7-9e36-64fccf15c98d admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.879626 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0ee21-914d-4ea7-9e36-64fccf15c98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:47.881300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0ee21-914d-4ea7-9e36-64fccf15c98d admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:47.905900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1381/2764] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:47 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:56:47.906143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d347a-fa97-4372-84dc-77af84a08feb None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.907896 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0ee21-914d-4ea7-9e36-64fccf15c98d admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:47.919399 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0ee21-914d-4ea7-9e36-64fccf15c98d admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:47.925747 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601aca3-f592-4b4d-8152-95bb9fae6ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.926779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601aca3-f592-4b4d-8152-95bb9fae6ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.927160 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601aca3-f592-4b4d-8152-95bb9fae6ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.927558 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601aca3-f592-4b4d-8152-95bb9fae6ca8 admin admin] PATH_INFO: `/v3/projects/c3c97c48fb024e25934d0e0dfd792a08/users/f68c563c821f44ffa82940a8bd592f68/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.930440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601aca3-f592-4b4d-8152-95bb9fae6ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c97c48fb024e25934d0e0dfd792a08, user_id=f68c563c821f44ffa82940a8bd592f68, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:47.934033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601aca3-f592-4b4d-8152-95bb9fae6ca8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:47.948835 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1382/2765] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:47 2021] PUT /identity/v3/projects/c3c97c48fb024e25934d0e0dfd792a08/users/f68c563c821f44ffa82940a8bd592f68/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:47.958349 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653f535-ad04-432d-9698-cfac38e645a2 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.958779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653f535-ad04-432d-9698-cfac38e645a2 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.959180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653f535-ad04-432d-9698-cfac38e645a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.984946 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f15f17-aef5-4f1a-92fc-5ce1692d3563 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:47.985627 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15f17-aef5-4f1a-92fc-5ce1692d3563 service swift] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:47.985907 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15f17-aef5-4f1a-92fc-5ce1692d3563 service swift] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:47.986179 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15f17-aef5-4f1a-92fc-5ce1692d3563 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:47.994793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-7653f535-ad04-432d-9698-cfac38e645a2 None None] MFA Rules not processed for user `f68c563c821f44ffa82940a8bd592f68`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:47.996163 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7653f535-ad04-432d-9698-cfac38e645a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:48.050754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f15f17-aef5-4f1a-92fc-5ce1692d3563 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:48.052948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f15f17-aef5-4f1a-92fc-5ce1692d3563 service swift] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:48.062661 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1384/2766] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:56:47 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Dec 13 16:56:48.072487 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1383/2767] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:47 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:56:48.083970 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f15f17-aef5-4f1a-92fc-5ce1692d3563 service swift] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:48.089036 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d7f15f17-aef5-4f1a-92fc-5ce1692d3563 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:48.201084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f15f17-aef5-4f1a-92fc-5ce1692d3563 service swift] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:48.271614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d76e5-b389-41d0-8fe1-23ecd6b8f170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:48.273391 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d76e5-b389-41d0-8fe1-23ecd6b8f170 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:48.273934 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d76e5-b389-41d0-8fe1-23ecd6b8f170 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:48.274208 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d76e5-b389-41d0-8fe1-23ecd6b8f170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:48.286446 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d76e5-b389-41d0-8fe1-23ecd6b8f170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:48.287939 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d76e5-b389-41d0-8fe1-23ecd6b8f170 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:48.299103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1385/2768] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:48 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:56:48.995663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653f535-ad04-432d-9698-cfac38e645a2 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:48.998430 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7653f535-ad04-432d-9698-cfac38e645a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:49.014069 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653f535-ad04-432d-9698-cfac38e645a2 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:49.018249 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e36c9-548d-4d21-b8df-826088fe1dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:49.019001 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e36c9-548d-4d21-b8df-826088fe1dfd service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:49.019367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e36c9-548d-4d21-b8df-826088fe1dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:49.019693 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e36c9-548d-4d21-b8df-826088fe1dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:49.091936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e36c9-548d-4d21-b8df-826088fe1dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:49.093423 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e36c9-548d-4d21-b8df-826088fe1dfd service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:49.108271 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1384/2769] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:48 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:56:53.411469 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d76e5-b389-41d0-8fe1-23ecd6b8f170 service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:53.423476 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d76e5-b389-41d0-8fe1-23ecd6b8f170 service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:53.428347 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6ec46d-8712-4ff7-907b-8fdfd3b0ac2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:53.429887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec46d-8712-4ff7-907b-8fdfd3b0ac2c service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:53.430392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec46d-8712-4ff7-907b-8fdfd3b0ac2c service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:53.431041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6ec46d-8712-4ff7-907b-8fdfd3b0ac2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:53.514113 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ec46d-8712-4ff7-907b-8fdfd3b0ac2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:53.515950 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6ec46d-8712-4ff7-907b-8fdfd3b0ac2c service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:53.530608 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1386/2770] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:53 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:56:55.773733 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e36c9-548d-4d21-b8df-826088fe1dfd service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:55.835364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e36c9-548d-4d21-b8df-826088fe1dfd service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:55.840647 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:55.841628 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:55.841981 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:55.842348 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] PATH_INFO: `/v3/users/8a8a970f7ee24da5bc903d5b1660df29` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:55.843641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8a970f7ee24da5bc903d5b1660df29)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:55.845886 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:55.906495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8a970f7ee24da5bc903d5b1660df29'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:55.920627 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8a970f7ee24da5bc903d5b1660df29'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:55.928130 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8a970f7ee24da5bc903d5b1660df29'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:55.935966 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8a970f7ee24da5bc903d5b1660df29'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:55.936706 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8a970f7ee24da5bc903d5b1660df29'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:55.945213 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1385/2771] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:56:55 2021] DELETE /identity/v3/users/8a8a970f7ee24da5bc903d5b1660df29 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:55.950143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d443a-daa9-49b7-8d62-ea6b24b02a8c None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:55.950640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d443a-daa9-49b7-8d62-ea6b24b02a8c None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:55.950754 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d443a-daa9-49b7-8d62-ea6b24b02a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:55.969389 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-ba3d443a-daa9-49b7-8d62-ea6b24b02a8c None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:55.970515 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ba3d443a-daa9-49b7-8d62-ea6b24b02a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:56.039993 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1387/2772] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:56.049818 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:56.051604 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:56.112489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ac5ab-30be-4235-8f89-f87870f17ad0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:56.116664 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46088c-ff29-4432-904a-f3e43b53d54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:56.117727 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46088c-ff29-4432-904a-f3e43b53d54a service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:56.118443 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46088c-ff29-4432-904a-f3e43b53d54a service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:56.119049 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef46088c-ff29-4432-904a-f3e43b53d54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:56.131465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46088c-ff29-4432-904a-f3e43b53d54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:56.131779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef46088c-ff29-4432-904a-f3e43b53d54a service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:56.143239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1386/2773] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:56:56.450501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d443a-daa9-49b7-8d62-ea6b24b02a8c None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:56.451954 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ba3d443a-daa9-49b7-8d62-ea6b24b02a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:56.464969 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d443a-daa9-49b7-8d62-ea6b24b02a8c None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:56.480859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:56.481749 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:56.482027 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:56.482397 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] PATH_INFO: `/v3/projects/bcd9884bbcec4ec1b470f7b42388eb6f` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:56.483528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd9884bbcec4ec1b470f7b42388eb6f)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:56.485510 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:56.542964 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd9884bbcec4ec1b470f7b42388eb6f', 'request_id': 'req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:56.554275 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd9884bbcec4ec1b470f7b42388eb6f', 'request_id': 'req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:56.562162 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd9884bbcec4ec1b470f7b42388eb6f', 'request_id': 'req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:56.575213 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] The token cache is being invalidate because project bcd9884bbcec4ec1b470f7b42388eb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:56:56.575497 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:56.576153 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:56.578205 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1388/2774] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:56:56 2021] DELETE /identity/v3/projects/bcd9884bbcec4ec1b470f7b42388eb6f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:56.582260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46088c-ff29-4432-904a-f3e43b53d54a service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:56.594776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef46088c-ff29-4432-904a-f3e43b53d54a service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:56.664833 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:56.665853 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:56.666192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:56.666529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] PATH_INFO: `/v3/users/9677fe1c471e4905bb583afa5e0278db` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:56.667800 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9677fe1c471e4905bb583afa5e0278db)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:56.669865 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:56.738434 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9677fe1c471e4905bb583afa5e0278db'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:56.751231 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9677fe1c471e4905bb583afa5e0278db'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:56.761457 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9677fe1c471e4905bb583afa5e0278db'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:56.769154 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9677fe1c471e4905bb583afa5e0278db'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:56.769824 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9677fe1c471e4905bb583afa5e0278db'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:56.777047 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1387/2775] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:56:56 2021] DELETE /identity/v3/users/9677fe1c471e4905bb583afa5e0278db => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:57.123680 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:57.125358 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:57.140768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e705b69-57fb-4c54-a2e8-67fdab5a3bc2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:57.212270 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:57.213260 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:57.213526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:57.213807 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] PATH_INFO: `/v3/projects/5563054dd16e48cb963fc18488ba3e7c` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:57.217362 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5563054dd16e48cb963fc18488ba3e7c)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:57.219477 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:57.281644 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5563054dd16e48cb963fc18488ba3e7c', 'request_id': 'req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.294352 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5563054dd16e48cb963fc18488ba3e7c', 'request_id': 'req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.302640 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5563054dd16e48cb963fc18488ba3e7c', 'request_id': 'req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.316509 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] The token cache is being invalidate because project 5563054dd16e48cb963fc18488ba3e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:56:57.317004 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.321526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.323826 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1389/2776] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:56:57 2021] DELETE /identity/v3/projects/5563054dd16e48cb963fc18488ba3e7c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:57.327516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:57.328946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:57.348230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f85f3-541f-446e-aa0a-843dd0192d3c admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:57.418875 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c978f3-edf4-400f-8630-f1b429298d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:57.419704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c978f3-edf4-400f-8630-f1b429298d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:57.419985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c978f3-edf4-400f-8630-f1b429298d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:57.420261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c978f3-edf4-400f-8630-f1b429298d80 admin admin] PATH_INFO: `/v3/users/f68c563c821f44ffa82940a8bd592f68` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:57.421834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c978f3-edf4-400f-8630-f1b429298d80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68c563c821f44ffa82940a8bd592f68)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:57.423993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c978f3-edf4-400f-8630-f1b429298d80 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:57.474139 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-21c978f3-edf4-400f-8630-f1b429298d80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68c563c821f44ffa82940a8bd592f68'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.487168 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-21c978f3-edf4-400f-8630-f1b429298d80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68c563c821f44ffa82940a8bd592f68'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.498060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-21c978f3-edf4-400f-8630-f1b429298d80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68c563c821f44ffa82940a8bd592f68'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.505489 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-21c978f3-edf4-400f-8630-f1b429298d80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68c563c821f44ffa82940a8bd592f68'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.506126 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-21c978f3-edf4-400f-8630-f1b429298d80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68c563c821f44ffa82940a8bd592f68'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.512760 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1388/2777] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:56:57 2021] DELETE /identity/v3/users/f68c563c821f44ffa82940a8bd592f68 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:57.796759 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:57.799185 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:57.814750 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf9ace-2649-4cc7-96ba-b9e02cdf5a02 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:57.885231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:57.886107 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:57.886415 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:57.886686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] PATH_INFO: `/v3/projects/c3c97c48fb024e25934d0e0dfd792a08` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:57.887992 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c97c48fb024e25934d0e0dfd792a08)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:57.889961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:57.902641 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c87abf-fb11-49ba-8e69-7f488e4fed29 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:57.903159 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c87abf-fb11-49ba-8e69-7f488e4fed29 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:57.903269 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c87abf-fb11-49ba-8e69-7f488e4fed29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:57.921424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-a2c87abf-fb11-49ba-8e69-7f488e4fed29 None None] MFA Rules not processed for user `9305e888877a4b799a83a512007958ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:57.922878 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a2c87abf-fb11-49ba-8e69-7f488e4fed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:57.937401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c97c48fb024e25934d0e0dfd792a08', 'request_id': 'req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.945253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c97c48fb024e25934d0e0dfd792a08', 'request_id': 'req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.951746 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c97c48fb024e25934d0e0dfd792a08', 'request_id': 'req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.962407 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] The token cache is being invalidate because project c3c97c48fb024e25934d0e0dfd792a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:56:57.962684 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.963399 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-5c88c4dc-4ac6-4d57-b869-3f80656d4a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:56:57.965085 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1390/2778] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:56:57 2021] DELETE /identity/v3/projects/c3c97c48fb024e25934d0e0dfd792a08 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:57.971859 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52a4c0-de5d-4a3f-9049-e8baa841c571 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:57.972143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52a4c0-de5d-4a3f-9049-e8baa841c571 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:57.972411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52a4c0-de5d-4a3f-9049-e8baa841c571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:57.979616 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1389/2779] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:57 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:56:57.991207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9a52a4c0-de5d-4a3f-9049-e8baa841c571 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:57.992420 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9a52a4c0-de5d-4a3f-9049-e8baa841c571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:58.051233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1391/2780] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:56:58.061042 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f91c5e-4e06-49a0-a8ae-2dee35665a41 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.061331 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f91c5e-4e06-49a0-a8ae-2dee35665a41 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.061612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f91c5e-4e06-49a0-a8ae-2dee35665a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.079793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-38f91c5e-4e06-49a0-a8ae-2dee35665a41 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:58.081228 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-38f91c5e-4e06-49a0-a8ae-2dee35665a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:58.089587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1390/2781] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:58.094055 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52a4c0-de5d-4a3f-9049-e8baa841c571 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.104071 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52a4c0-de5d-4a3f-9049-e8baa841c571 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.109103 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e9a38-6710-4b9f-a799-46586d96c8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.109795 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9a38-6710-4b9f-a799-46586d96c8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.110077 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9a38-6710-4b9f-a799-46586d96c8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.110344 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e9a38-6710-4b9f-a799-46586d96c8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.111043 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e9a38-6710-4b9f-a799-46586d96c8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:56:58.111461 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e9a38-6710-4b9f-a799-46586d96c8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.113124 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e9a38-6710-4b9f-a799-46586d96c8b9 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.124887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1392/2782] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:56:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:56:58.129230 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f91c5e-4e06-49a0-a8ae-2dee35665a41 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.139053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f91c5e-4e06-49a0-a8ae-2dee35665a41 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.144061 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1e32f-bbf2-42f4-9768-8fb7a26f0b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.144766 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e32f-bbf2-42f4-9768-8fb7a26f0b61 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.145053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e32f-bbf2-42f4-9768-8fb7a26f0b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.145387 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1e32f-bbf2-42f4-9768-8fb7a26f0b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.146107 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1e32f-bbf2-42f4-9768-8fb7a26f0b61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.148086 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1e32f-bbf2-42f4-9768-8fb7a26f0b61 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.178426 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1391/2783] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:56:58 2021] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:56:58.179564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e9a38-6710-4b9f-a799-46586d96c8b9 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.189425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e9a38-6710-4b9f-a799-46586d96c8b9 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.246270 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43838262-52c4-41ab-9701-5ace939a24d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.247058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838262-52c4-41ab-9701-5ace939a24d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.247322 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838262-52c4-41ab-9701-5ace939a24d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.247612 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838262-52c4-41ab-9701-5ace939a24d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.248310 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43838262-52c4-41ab-9701-5ace939a24d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.250361 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43838262-52c4-41ab-9701-5ace939a24d4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.275502 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1393/2784] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:56:58 2021] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:56:58.276765 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1e32f-bbf2-42f4-9768-8fb7a26f0b61 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.286913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1e32f-bbf2-42f4-9768-8fb7a26f0b61 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.292023 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312bfd3-e3d4-40b9-a561-66af597abd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.292714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312bfd3-e3d4-40b9-a561-66af597abd41 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.292994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312bfd3-e3d4-40b9-a561-66af597abd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.293266 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312bfd3-e3d4-40b9-a561-66af597abd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.294010 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312bfd3-e3d4-40b9-a561-66af597abd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.295607 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312bfd3-e3d4-40b9-a561-66af597abd41 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.306498 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1392/2785] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:58.310382 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43838262-52c4-41ab-9701-5ace939a24d4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.320953 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43838262-52c4-41ab-9701-5ace939a24d4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.328548 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed94881-97ad-4433-81bf-46ea78d43c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.329955 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed94881-97ad-4433-81bf-46ea78d43c6f admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.330249 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed94881-97ad-4433-81bf-46ea78d43c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.330520 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed94881-97ad-4433-81bf-46ea78d43c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.331273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed94881-97ad-4433-81bf-46ea78d43c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.332923 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed94881-97ad-4433-81bf-46ea78d43c6f admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.352741 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1394/2786] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:58.354326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312bfd3-e3d4-40b9-a561-66af597abd41 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.364256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312bfd3-e3d4-40b9-a561-66af597abd41 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.369446 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71c97b-a83e-4217-a60f-4a39e0b16786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.370329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c97b-a83e-4217-a60f-4a39e0b16786 admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.370613 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c97b-a83e-4217-a60f-4a39e0b16786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.370885 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71c97b-a83e-4217-a60f-4a39e0b16786 admin admin] PATH_INFO: `/v3/projects/0026754a1a3345ffabd0ffd6e22c050c/users/61cc429c142c466da1df66744e0cc985/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.388233 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71c97b-a83e-4217-a60f-4a39e0b16786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0026754a1a3345ffabd0ffd6e22c050c, user_id=61cc429c142c466da1df66744e0cc985, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.391159 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71c97b-a83e-4217-a60f-4a39e0b16786 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.406745 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1393/2787] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:58 2021] PUT /identity/v3/projects/0026754a1a3345ffabd0ffd6e22c050c/users/61cc429c142c466da1df66744e0cc985/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:56:58.418106 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf77b2-5675-425e-94ac-d3bb8ed2615e None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.418390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf77b2-5675-425e-94ac-d3bb8ed2615e None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.418668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf77b2-5675-425e-94ac-d3bb8ed2615e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.446864 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-cdcf77b2-5675-425e-94ac-d3bb8ed2615e None None] MFA Rules not processed for user `61cc429c142c466da1df66744e0cc985`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:58.448116 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-cdcf77b2-5675-425e-94ac-d3bb8ed2615e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:58.527343 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1395/2788] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:58 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:58.532060 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71c97b-a83e-4217-a60f-4a39e0b16786 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.597556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71c97b-a83e-4217-a60f-4a39e0b16786 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.612795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d5c16-e697-4cdf-a1d1-3d3cebbff28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.612795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5c16-e697-4cdf-a1d1-3d3cebbff28a admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.612795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5c16-e697-4cdf-a1d1-3d3cebbff28a admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.612795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d5c16-e697-4cdf-a1d1-3d3cebbff28a admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.613560 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d5c16-e697-4cdf-a1d1-3d3cebbff28a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.615290 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d5c16-e697-4cdf-a1d1-3d3cebbff28a admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.643278 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1394/2789] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:56:58 2021] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:56:58.647781 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf77b2-5675-425e-94ac-d3bb8ed2615e None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.659614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf77b2-5675-425e-94ac-d3bb8ed2615e None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.717146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a068a9c-d348-45f9-b58d-c1ea643afd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.717736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a068a9c-d348-45f9-b58d-c1ea643afd67 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.718017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a068a9c-d348-45f9-b58d-c1ea643afd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.718287 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a068a9c-d348-45f9-b58d-c1ea643afd67 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.718987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a068a9c-d348-45f9-b58d-c1ea643afd67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.721468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a068a9c-d348-45f9-b58d-c1ea643afd67 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.745135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1396/2790] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:56:58 2021] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:56:58.749365 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d5c16-e697-4cdf-a1d1-3d3cebbff28a admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.760718 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d5c16-e697-4cdf-a1d1-3d3cebbff28a admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.765420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fed1dc-785c-4825-bfc5-98c9837598b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.766181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fed1dc-785c-4825-bfc5-98c9837598b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.766458 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fed1dc-785c-4825-bfc5-98c9837598b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.766728 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fed1dc-785c-4825-bfc5-98c9837598b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.767465 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fed1dc-785c-4825-bfc5-98c9837598b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.769097 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fed1dc-785c-4825-bfc5-98c9837598b9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.780544 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1395/2791] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:58.785061 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a068a9c-d348-45f9-b58d-c1ea643afd67 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.796425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a068a9c-d348-45f9-b58d-c1ea643afd67 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.801914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93754dc9-1e98-46e1-b7ea-17086ff0ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.802997 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93754dc9-1e98-46e1-b7ea-17086ff0ad3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.803308 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93754dc9-1e98-46e1-b7ea-17086ff0ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.803668 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93754dc9-1e98-46e1-b7ea-17086ff0ad3a admin admin] PATH_INFO: `/v3/projects/0da1fdefced74ef4afe9fed3be7d02ea/users/7f2c5ca0453d40fe9aabb9d6e81a95b1/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.820251 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93754dc9-1e98-46e1-b7ea-17086ff0ad3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da1fdefced74ef4afe9fed3be7d02ea, user_id=7f2c5ca0453d40fe9aabb9d6e81a95b1, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.823929 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93754dc9-1e98-46e1-b7ea-17086ff0ad3a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.837845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1397/2792] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:58 2021] PUT /identity/v3/projects/0da1fdefced74ef4afe9fed3be7d02ea/users/7f2c5ca0453d40fe9aabb9d6e81a95b1/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:56:58.841969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fed1dc-785c-4825-bfc5-98c9837598b9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.851917 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fed1dc-785c-4825-bfc5-98c9837598b9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.912329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ee80d-ad7d-4126-89e3-cf0d20a9ebaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.913125 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee80d-ad7d-4126-89e3-cf0d20a9ebaf admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.913281 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee80d-ad7d-4126-89e3-cf0d20a9ebaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.913670 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee80d-ad7d-4126-89e3-cf0d20a9ebaf admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.914575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee80d-ad7d-4126-89e3-cf0d20a9ebaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.916283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee80d-ad7d-4126-89e3-cf0d20a9ebaf admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.926205 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1396/2793] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:56:58 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:56:58.930834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93754dc9-1e98-46e1-b7ea-17086ff0ad3a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:58.941631 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93754dc9-1e98-46e1-b7ea-17086ff0ad3a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:58.946587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d01d25-481a-4c88-9b78-a5206c2096a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:58.947499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d01d25-481a-4c88-9b78-a5206c2096a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.947782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d01d25-481a-4c88-9b78-a5206c2096a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.948050 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d01d25-481a-4c88-9b78-a5206c2096a4 admin admin] PATH_INFO: `/v3/projects/0da1fdefced74ef4afe9fed3be7d02ea/users/7f2c5ca0453d40fe9aabb9d6e81a95b1/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:58.950166 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d01d25-481a-4c88-9b78-a5206c2096a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0da1fdefced74ef4afe9fed3be7d02ea, user_id=7f2c5ca0453d40fe9aabb9d6e81a95b1, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:58.952993 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d01d25-481a-4c88-9b78-a5206c2096a4 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:58.964691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1398/2794] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:56:58 2021] PUT /identity/v3/projects/0da1fdefced74ef4afe9fed3be7d02ea/users/7f2c5ca0453d40fe9aabb9d6e81a95b1/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:56:58.975417 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b37e-e82e-4a7b-8795-dd6a64364b06 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:58.975657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b37e-e82e-4a7b-8795-dd6a64364b06 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:58.975930 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b4b37e-e82e-4a7b-8795-dd6a64364b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:59.004940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-78b4b37e-e82e-4a7b-8795-dd6a64364b06 None None] MFA Rules not processed for user `7f2c5ca0453d40fe9aabb9d6e81a95b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:56:59.006144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-78b4b37e-e82e-4a7b-8795-dd6a64364b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:59.041345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d01d25-481a-4c88-9b78-a5206c2096a4 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:59.043385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d6d01d25-481a-4c88-9b78-a5206c2096a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:59.083053 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1397/2795] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:56:58 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:56:59.093813 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4b37e-e82e-4a7b-8795-dd6a64364b06 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:59.095251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-78b4b37e-e82e-4a7b-8795-dd6a64364b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:59.115180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d01d25-481a-4c88-9b78-a5206c2096a4 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:59.120881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53649f86-331c-4257-ba75-c78a28f565ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b7187c26dd41bea9f3c2b49de8ef28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:59.121532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649f86-331c-4257-ba75-c78a28f565ac service placement] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:59.121813 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649f86-331c-4257-ba75-c78a28f565ac service placement] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:59.122084 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53649f86-331c-4257-ba75-c78a28f565ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:59.123881 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-53649f86-331c-4257-ba75-c78a28f565ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:56:59.135935 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53649f86-331c-4257-ba75-c78a28f565ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:59.137563 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53649f86-331c-4257-ba75-c78a28f565ac service placement] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:59.147442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1399/2796] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:59 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:56:59.151939 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b4b37e-e82e-4a7b-8795-dd6a64364b06 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:59.155770 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9e2f8-b8c0-4b6d-9322-6bccb0c66802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:59.156483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9e2f8-b8c0-4b6d-9322-6bccb0c66802 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:59.156846 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9e2f8-b8c0-4b6d-9322-6bccb0c66802 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:59.157119 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9e2f8-b8c0-4b6d-9322-6bccb0c66802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:59.167002 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9e2f8-b8c0-4b6d-9322-6bccb0c66802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:59.168475 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9e2f8-b8c0-4b6d-9322-6bccb0c66802 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:59.177855 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1398/2797] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:59 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Dec 13 16:56:59.275591 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53649f86-331c-4257-ba75-c78a28f565ac service placement] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:56:59.287271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53649f86-331c-4257-ba75-c78a28f565ac service placement] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:56:59.291667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cf3b5-3ed7-4c90-a12e-7dbb0dd70728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:56:59.292480 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf3b5-3ed7-4c90-a12e-7dbb0dd70728 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:56:59.293019 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf3b5-3ed7-4c90-a12e-7dbb0dd70728 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:56:59.293298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cf3b5-3ed7-4c90-a12e-7dbb0dd70728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:56:59.354851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cf3b5-3ed7-4c90-a12e-7dbb0dd70728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:56:59.356170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cf3b5-3ed7-4c90-a12e-7dbb0dd70728 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:56:59.365501 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1400/2798] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:56:59 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:57:00.018221 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf6e2-9576-4ae2-80fd-201122456002 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:00.018713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf6e2-9576-4ae2-80fd-201122456002 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:00.018907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02cf6e2-9576-4ae2-80fd-201122456002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:00.037277 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-f02cf6e2-9576-4ae2-80fd-201122456002 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:57:00.038552 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-f02cf6e2-9576-4ae2-80fd-201122456002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:00.098134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1399/2799] 10.222.0.62 () {58 vars in 1009 bytes} [Mon Dec 13 16:57:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:57:00.113782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cf3b5-3ed7-4c90-a12e-7dbb0dd70728 service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:00.116064 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-d01cf3b5-3ed7-4c90-a12e-7dbb0dd70728 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:00.193637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cf3b5-3ed7-4c90-a12e-7dbb0dd70728 service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:00.200148 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282f259-66d4-4cb5-a0aa-e630d0eee1f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:00.200853 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282f259-66d4-4cb5-a0aa-e630d0eee1f6 service swift] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:00.201122 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282f259-66d4-4cb5-a0aa-e630d0eee1f6 service swift] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:00.201393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282f259-66d4-4cb5-a0aa-e630d0eee1f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:00.210577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282f259-66d4-4cb5-a0aa-e630d0eee1f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:00.212318 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282f259-66d4-4cb5-a0aa-e630d0eee1f6 service swift] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:00.221286 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1401/2800] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:57:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:57:02.072796 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf6e2-9576-4ae2-80fd-201122456002 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:02.155969 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02cf6e2-9576-4ae2-80fd-201122456002 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:02.160514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:02.161492 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:02.161836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:02.162840 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] PATH_INFO: `/v3/users/61cc429c142c466da1df66744e0cc985` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:02.164144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=61cc429c142c466da1df66744e0cc985)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:02.166277 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:02.220973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61cc429c142c466da1df66744e0cc985'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:02.233075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61cc429c142c466da1df66744e0cc985'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:02.241504 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61cc429c142c466da1df66744e0cc985'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:02.249012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61cc429c142c466da1df66744e0cc985'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:02.249658 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61cc429c142c466da1df66744e0cc985'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:02.255482 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1400/2801] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:57:02 2021] DELETE /identity/v3/users/61cc429c142c466da1df66744e0cc985 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:57:02.261296 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783026c-804d-4659-b01b-bc9562af2ec3 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:02.261763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783026c-804d-4659-b01b-bc9562af2ec3 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:02.261861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783026c-804d-4659-b01b-bc9562af2ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:02.286535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9783026c-804d-4659-b01b-bc9562af2ec3 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:57:02.287789 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9783026c-804d-4659-b01b-bc9562af2ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:02.357978 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1402/2802] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:57:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:57:02.371065 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:02.372542 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:02.433424 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9790d-5dd4-4bd9-97ff-226e79ce9c7e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:02.436994 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9587d3-e6be-4aa1-80ea-6bb53b59ae27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:02.437667 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9587d3-e6be-4aa1-80ea-6bb53b59ae27 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:02.437946 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9587d3-e6be-4aa1-80ea-6bb53b59ae27 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:02.438220 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9587d3-e6be-4aa1-80ea-6bb53b59ae27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:02.447566 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9587d3-e6be-4aa1-80ea-6bb53b59ae27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:02.449058 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9587d3-e6be-4aa1-80ea-6bb53b59ae27 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:02.460143 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1401/2803] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:57:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:57:02.768961 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783026c-804d-4659-b01b-bc9562af2ec3 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:02.770559 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9783026c-804d-4659-b01b-bc9562af2ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:02.790988 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783026c-804d-4659-b01b-bc9562af2ec3 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:02.796164 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:02.797217 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:02.797498 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:02.797772 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] PATH_INFO: `/v3/projects/0026754a1a3345ffabd0ffd6e22c050c` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:02.801664 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0026754a1a3345ffabd0ffd6e22c050c)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:02.803820 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:02.861874 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0026754a1a3345ffabd0ffd6e22c050c', 'request_id': 'req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:02.871447 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0026754a1a3345ffabd0ffd6e22c050c', 'request_id': 'req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:02.878302 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0026754a1a3345ffabd0ffd6e22c050c', 'request_id': 'req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:02.892267 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] The token cache is being invalidate because project 0026754a1a3345ffabd0ffd6e22c050c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:57:02.892558 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:02.893385 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:02.895872 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1403/2804] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:57:02 2021] DELETE /identity/v3/projects/0026754a1a3345ffabd0ffd6e22c050c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:57:02.899948 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9587d3-e6be-4aa1-80ea-6bb53b59ae27 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:02.910303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9587d3-e6be-4aa1-80ea-6bb53b59ae27 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:02.969811 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf609d-255d-4870-a197-90271d698bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:02.971012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf609d-255d-4870-a197-90271d698bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:02.971488 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf609d-255d-4870-a197-90271d698bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:02.971758 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf609d-255d-4870-a197-90271d698bfd admin admin] PATH_INFO: `/v3/users/7f2c5ca0453d40fe9aabb9d6e81a95b1` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:02.973364 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf609d-255d-4870-a197-90271d698bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2c5ca0453d40fe9aabb9d6e81a95b1)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:02.975767 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf609d-255d-4870-a197-90271d698bfd admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:03.030008 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f1cf609d-255d-4870-a197-90271d698bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2c5ca0453d40fe9aabb9d6e81a95b1'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:03.044433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f1cf609d-255d-4870-a197-90271d698bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2c5ca0453d40fe9aabb9d6e81a95b1'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:03.055864 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f1cf609d-255d-4870-a197-90271d698bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2c5ca0453d40fe9aabb9d6e81a95b1'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:03.063939 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f1cf609d-255d-4870-a197-90271d698bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2c5ca0453d40fe9aabb9d6e81a95b1'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:03.064599 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-f1cf609d-255d-4870-a197-90271d698bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2c5ca0453d40fe9aabb9d6e81a95b1'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:03.070662 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1402/2805] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:57:02 2021] DELETE /identity/v3/users/7f2c5ca0453d40fe9aabb9d6e81a95b1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:57:03.397759 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:03.399399 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:03.414022 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c2204-7021-4a4e-a62e-b393dee4f1c7 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:03.480996 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:03.481959 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:03.482238 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:03.482514 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] PATH_INFO: `/v3/projects/0da1fdefced74ef4afe9fed3be7d02ea` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:03.483755 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0da1fdefced74ef4afe9fed3be7d02ea)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:03.485691 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:03.533240 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0da1fdefced74ef4afe9fed3be7d02ea', 'request_id': 'req-482750e1-e055-4790-a9bd-e0bbc1745d65'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:03.543740 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0da1fdefced74ef4afe9fed3be7d02ea', 'request_id': 'req-482750e1-e055-4790-a9bd-e0bbc1745d65'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:03.551641 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0da1fdefced74ef4afe9fed3be7d02ea', 'request_id': 'req-482750e1-e055-4790-a9bd-e0bbc1745d65'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:03.563404 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] The token cache is being invalidate because project 0da1fdefced74ef4afe9fed3be7d02ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:57:03.563696 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:03.564413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-482750e1-e055-4790-a9bd-e0bbc1745d65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:03.570271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1404/2806] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:57:03 2021] DELETE /identity/v3/projects/0da1fdefced74ef4afe9fed3be7d02ea => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:57:03.572515 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784ff9-cd3b-4e7f-9873-d15bb8950bef None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:03.573039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784ff9-cd3b-4e7f-9873-d15bb8950bef None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:03.573138 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0784ff9-cd3b-4e7f-9873-d15bb8950bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:03.591714 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-d0784ff9-cd3b-4e7f-9873-d15bb8950bef None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:57:03.592952 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-d0784ff9-cd3b-4e7f-9873-d15bb8950bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:03.664021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1403/2807] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:57:03.673145 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec87e-a6c0-4652-b6e0-91a377e26ad4 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:03.673367 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec87e-a6c0-4652-b6e0-91a377e26ad4 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:03.673639 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec87e-a6c0-4652-b6e0-91a377e26ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:03.696425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-a28ec87e-a6c0-4652-b6e0-91a377e26ad4 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:57:03.697146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-a28ec87e-a6c0-4652-b6e0-91a377e26ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:03.709135 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1405/2808] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:57:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:57:03.709470 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0784ff9-cd3b-4e7f-9873-d15bb8950bef None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:03.720543 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0784ff9-cd3b-4e7f-9873-d15bb8950bef None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:03.726726 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c5772-67d4-42f2-8b1b-338305c68f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:03.727614 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5772-67d4-42f2-8b1b-338305c68f40 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:03.728433 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5772-67d4-42f2-8b1b-338305c68f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:03.728915 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c5772-67d4-42f2-8b1b-338305c68f40 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:03.729841 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c5772-67d4-42f2-8b1b-338305c68f40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:57:03.730204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c5772-67d4-42f2-8b1b-338305c68f40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:03.732117 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c5772-67d4-42f2-8b1b-338305c68f40 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:03.746192 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1404/2809] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:57:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Dec 13 16:57:03.751473 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec87e-a6c0-4652-b6e0-91a377e26ad4 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:03.761141 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec87e-a6c0-4652-b6e0-91a377e26ad4 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:03.765863 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e76bd-5969-408a-99e4-76b2921ac926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:03.766528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e76bd-5969-408a-99e4-76b2921ac926 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:03.766809 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e76bd-5969-408a-99e4-76b2921ac926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:03.767082 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e76bd-5969-408a-99e4-76b2921ac926 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:03.767826 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e76bd-5969-408a-99e4-76b2921ac926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:03.769762 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e76bd-5969-408a-99e4-76b2921ac926 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:03.803649 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1406/2810] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:57:03 2021] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Dec 13 16:57:03.804556 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c5772-67d4-42f2-8b1b-338305c68f40 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:03.815978 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c5772-67d4-42f2-8b1b-338305c68f40 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:03.876948 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d02e0-14ac-49ea-a3cb-8512110aaad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:03.877635 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d02e0-14ac-49ea-a3cb-8512110aaad8 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:03.877921 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d02e0-14ac-49ea-a3cb-8512110aaad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:03.878196 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92d02e0-14ac-49ea-a3cb-8512110aaad8 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:03.878910 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d02e0-14ac-49ea-a3cb-8512110aaad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:03.880869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92d02e0-14ac-49ea-a3cb-8512110aaad8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:03.903822 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1405/2811] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:57:03 2021] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:57:03.908172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e76bd-5969-408a-99e4-76b2921ac926 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:03.919392 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e76bd-5969-408a-99e4-76b2921ac926 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:03.927858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ba8c-3432-4c82-bed2-9cf71ad6d92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:03.928450 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ba8c-3432-4c82-bed2-9cf71ad6d92e admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:03.928761 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ba8c-3432-4c82-bed2-9cf71ad6d92e admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:03.929028 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99ba8c-3432-4c82-bed2-9cf71ad6d92e admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:03.929801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ba8c-3432-4c82-bed2-9cf71ad6d92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:03.931435 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99ba8c-3432-4c82-bed2-9cf71ad6d92e admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:03.942625 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1407/2812] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:57:03 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:57:03.946847 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d02e0-14ac-49ea-a3cb-8512110aaad8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:03.957077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92d02e0-14ac-49ea-a3cb-8512110aaad8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:03.962162 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce2c20-8273-4404-8ffd-c88e7eb86a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:03.962816 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce2c20-8273-4404-8ffd-c88e7eb86a84 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:03.963100 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce2c20-8273-4404-8ffd-c88e7eb86a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:03.963378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce2c20-8273-4404-8ffd-c88e7eb86a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:03.964147 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce2c20-8273-4404-8ffd-c88e7eb86a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:03.965806 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce2c20-8273-4404-8ffd-c88e7eb86a84 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:03.983749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1406/2813] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:57:03 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:57:03.986481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ba8c-3432-4c82-bed2-9cf71ad6d92e admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:03.997295 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99ba8c-3432-4c82-bed2-9cf71ad6d92e admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:04.002396 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38743399-766b-46db-9a01-37d73f157cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:04.003499 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743399-766b-46db-9a01-37d73f157cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:04.003834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743399-766b-46db-9a01-37d73f157cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:04.004172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743399-766b-46db-9a01-37d73f157cd2 admin admin] PATH_INFO: `/v3/projects/6e64614ff028467e840fc5b4195e9d29/users/b56db35c47444f2db4a4a86de8934630/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:04.021428 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38743399-766b-46db-9a01-37d73f157cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e64614ff028467e840fc5b4195e9d29, user_id=b56db35c47444f2db4a4a86de8934630, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:04.024564 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38743399-766b-46db-9a01-37d73f157cd2 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:04.038576 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1408/2814] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:57:03 2021] PUT /identity/v3/projects/6e64614ff028467e840fc5b4195e9d29/users/b56db35c47444f2db4a4a86de8934630/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:57:04.049329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46db3-3a5c-4b75-a288-155aa165718a None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:04.049620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46db3-3a5c-4b75-a288-155aa165718a None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:04.049957 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b46db3-3a5c-4b75-a288-155aa165718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:04.075992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-74b46db3-3a5c-4b75-a288-155aa165718a None None] MFA Rules not processed for user `b56db35c47444f2db4a4a86de8934630`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:57:04.077219 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-74b46db3-3a5c-4b75-a288-155aa165718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:04.143945 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1407/2815] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:57:04 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:57:04.161834 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38743399-766b-46db-9a01-37d73f157cd2 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:04.164001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-38743399-766b-46db-9a01-37d73f157cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:04.230987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38743399-766b-46db-9a01-37d73f157cd2 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:04.234681 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd689fba-6e8b-42da-847e-e84784b5faf4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18f1422ce48e44ab85e6d5e10d1ea898', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:04.235326 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd689fba-6e8b-42da-847e-e84784b5faf4 service glance] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:04.235606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd689fba-6e8b-42da-847e-e84784b5faf4 service glance] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:04.235880 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd689fba-6e8b-42da-847e-e84784b5faf4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:04.244446 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd689fba-6e8b-42da-847e-e84784b5faf4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:04.245919 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd689fba-6e8b-42da-847e-e84784b5faf4 service glance] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:04.254433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1409/2816] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:57:04 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:57:21.923589 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b46db3-3a5c-4b75-a288-155aa165718a None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:21.999809 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b46db3-3a5c-4b75-a288-155aa165718a None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:22.005637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:22.006516 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:22.006795 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:22.007068 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] PATH_INFO: `/v3/users/b56db35c47444f2db4a4a86de8934630` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:22.008325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56db35c47444f2db4a4a86de8934630)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:22.010300 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:22.060948 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56db35c47444f2db4a4a86de8934630'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:22.072620 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56db35c47444f2db4a4a86de8934630'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:22.082547 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56db35c47444f2db4a4a86de8934630'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:22.094255 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56db35c47444f2db4a4a86de8934630'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:22.095003 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56db35c47444f2db4a4a86de8934630'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:22.105218 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1408/2817] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:57:21 2021] DELETE /identity/v3/users/b56db35c47444f2db4a4a86de8934630 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:57:22.111419 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ba941-ab9f-4dfc-ad30-1a12e850be4d None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:22.111990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ba941-ab9f-4dfc-ad30-1a12e850be4d None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:22.111990 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999ba941-ab9f-4dfc-ad30-1a12e850be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:22.131204 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-999ba941-ab9f-4dfc-ad30-1a12e850be4d None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:57:22.132398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-999ba941-ab9f-4dfc-ad30-1a12e850be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:22.193192 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1410/2818] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:57:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:57:22.205674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:22.207204 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:22.266799 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8eea8-ccad-4ec0-84be-3b4548e04ffe admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:22.272183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc533a0-9d6f-4ec9-bd55-7c9293abd276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:22.272900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc533a0-9d6f-4ec9-bd55-7c9293abd276 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:22.273180 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc533a0-9d6f-4ec9-bd55-7c9293abd276 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:22.273456 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc533a0-9d6f-4ec9-bd55-7c9293abd276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:22.284629 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc533a0-9d6f-4ec9-bd55-7c9293abd276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:22.286452 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc533a0-9d6f-4ec9-bd55-7c9293abd276 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:22.300149 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1409/2819] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:57:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:57:22.583977 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ba941-ab9f-4dfc-ad30-1a12e850be4d None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:22.585702 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-999ba941-ab9f-4dfc-ad30-1a12e850be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:22.598298 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999ba941-ab9f-4dfc-ad30-1a12e850be4d None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:22.603232 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:22.604091 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:22.604363 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:22.604656 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] PATH_INFO: `/v3/projects/6e64614ff028467e840fc5b4195e9d29` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:22.605861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e64614ff028467e840fc5b4195e9d29)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:22.608340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:22.659704 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e64614ff028467e840fc5b4195e9d29', 'request_id': 'req-790051d2-0b5a-4705-8f01-9d9db657d000'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:22.671329 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e64614ff028467e840fc5b4195e9d29', 'request_id': 'req-790051d2-0b5a-4705-8f01-9d9db657d000'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:22.679117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e64614ff028467e840fc5b4195e9d29', 'request_id': 'req-790051d2-0b5a-4705-8f01-9d9db657d000'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:22.693143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] The token cache is being invalidate because project 6e64614ff028467e840fc5b4195e9d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86095) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:57:22.693439 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:22.694504 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-790051d2-0b5a-4705-8f01-9d9db657d000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:22.700768 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1411/2820] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:57:22 2021] DELETE /identity/v3/projects/6e64614ff028467e840fc5b4195e9d29 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:57:22.703975 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7218a-7e03-45d8-8e6c-b42734af4be0 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:22.704294 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7218a-7e03-45d8-8e6c-b42734af4be0 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:22.704587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7218a-7e03-45d8-8e6c-b42734af4be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:22.723532 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-1fb7218a-7e03-45d8-8e6c-b42734af4be0 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:57:22.724769 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-1fb7218a-7e03-45d8-8e6c-b42734af4be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:22.788825 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1410/2821] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:57:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:57:22.800233 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88bb0-7528-4953-ae4c-6cf52f5787ba None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:22.800524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88bb0-7528-4953-ae4c-6cf52f5787ba None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:22.800817 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88bb0-7528-4953-ae4c-6cf52f5787ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:22.820117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-9bd88bb0-7528-4953-ae4c-6cf52f5787ba None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:57:22.821327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9bd88bb0-7528-4953-ae4c-6cf52f5787ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:22.829531 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1412/2822] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:57:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:57:22.835140 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7218a-7e03-45d8-8e6c-b42734af4be0 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:22.845580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7218a-7e03-45d8-8e6c-b42734af4be0 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:22.853326 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb7519-4440-4c82-87de-71d526146fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:22.854280 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb7519-4440-4c82-87de-71d526146fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:22.854627 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb7519-4440-4c82-87de-71d526146fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:22.854965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb7519-4440-4c82-87de-71d526146fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:22.855939 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb7519-4440-4c82-87de-71d526146fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86094) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:57:22.856316 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb7519-4440-4c82-87de-71d526146fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:22.858785 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb7519-4440-4c82-87de-71d526146fb0 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:22.870547 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1411/2823] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:57:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:57:22.875068 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd88bb0-7528-4953-ae4c-6cf52f5787ba None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:22.885015 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd88bb0-7528-4953-ae4c-6cf52f5787ba None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:22.890524 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4146817-8646-4833-9f8d-209e421851d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:22.891845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146817-8646-4833-9f8d-209e421851d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:22.892129 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146817-8646-4833-9f8d-209e421851d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:22.892405 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146817-8646-4833-9f8d-209e421851d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:22.893142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4146817-8646-4833-9f8d-209e421851d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:22.895035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4146817-8646-4833-9f8d-209e421851d0 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:22.926181 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1413/2824] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:57:22 2021] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:57:22.930366 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb7519-4440-4c82-87de-71d526146fb0 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:22.941239 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb7519-4440-4c82-87de-71d526146fb0 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:22.999405 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfec49-2c4e-427b-ab92-3c856cd75e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:22.999981 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfec49-2c4e-427b-ab92-3c856cd75e59 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:23.000353 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfec49-2c4e-427b-ab92-3c856cd75e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:23.000794 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfec49-2c4e-427b-ab92-3c856cd75e59 admin admin] PATH_INFO: `/v3/users` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:23.001534 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfec49-2c4e-427b-ab92-3c856cd75e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:23.003907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfec49-2c4e-427b-ab92-3c856cd75e59 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:23.028357 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1412/2825] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:57:22 2021] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:57:23.032659 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4146817-8646-4833-9f8d-209e421851d0 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:23.044005 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4146817-8646-4833-9f8d-209e421851d0 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:23.049315 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ca7b5-3b23-4821-b497-7ac032b3eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:23.049982 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ca7b5-3b23-4821-b497-7ac032b3eb1b admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:23.050257 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ca7b5-3b23-4821-b497-7ac032b3eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:23.050526 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ca7b5-3b23-4821-b497-7ac032b3eb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:23.051293 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ca7b5-3b23-4821-b497-7ac032b3eb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:23.052914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ca7b5-3b23-4821-b497-7ac032b3eb1b admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:23.063338 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1414/2826] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:57:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Dec 13 16:57:23.067508 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfec49-2c4e-427b-ab92-3c856cd75e59 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:23.077254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfec49-2c4e-427b-ab92-3c856cd75e59 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:23.082047 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ce074-28a5-435d-8328-6d4a187b9d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:23.082704 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce074-28a5-435d-8328-6d4a187b9d01 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:23.082982 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce074-28a5-435d-8328-6d4a187b9d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:23.083254 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ce074-28a5-435d-8328-6d4a187b9d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:23.083992 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ce074-28a5-435d-8328-6d4a187b9d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:23.085619 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ce074-28a5-435d-8328-6d4a187b9d01 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:23.096203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1413/2827] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:57:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:57:23.100596 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ca7b5-3b23-4821-b497-7ac032b3eb1b admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:23.113866 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ca7b5-3b23-4821-b497-7ac032b3eb1b admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:23.121025 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b54a3c-9429-40c6-9614-68b4c1ee4aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:23.122345 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b54a3c-9429-40c6-9614-68b4c1ee4aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:23.122742 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b54a3c-9429-40c6-9614-68b4c1ee4aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:23.123143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b54a3c-9429-40c6-9614-68b4c1ee4aaa admin admin] PATH_INFO: `/v3/projects/cd4fe18b4c364f05a6910c285913dd0f/users/37e3388b24494903a8a6eb1dda6988cc/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:23.140258 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b54a3c-9429-40c6-9614-68b4c1ee4aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4fe18b4c364f05a6910c285913dd0f, user_id=37e3388b24494903a8a6eb1dda6988cc, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:23.142959 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b54a3c-9429-40c6-9614-68b4c1ee4aaa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:23.159193 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1415/2828] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:57:23 2021] PUT /identity/v3/projects/cd4fe18b4c364f05a6910c285913dd0f/users/37e3388b24494903a8a6eb1dda6988cc/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:57:23.169725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc89c4a-d793-4882-be8a-21a989127449 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:23.170019 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc89c4a-d793-4882-be8a-21a989127449 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:23.170298 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc89c4a-d793-4882-be8a-21a989127449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:23.198593 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-2dc89c4a-d793-4882-be8a-21a989127449 None None] MFA Rules not processed for user `37e3388b24494903a8a6eb1dda6988cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:57:23.199834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2dc89c4a-d793-4882-be8a-21a989127449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:23.265075 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1414/2829] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:57:23 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:57:23.276442 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b54a3c-9429-40c6-9614-68b4c1ee4aaa admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:23.278387 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e9b54a3c-9429-40c6-9614-68b4c1ee4aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:23.341352 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b54a3c-9429-40c6-9614-68b4c1ee4aaa admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:23.345914 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faa17c-9e3b-4aa0-a393-9eef84a5a947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:23.346570 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faa17c-9e3b-4aa0-a393-9eef84a5a947 service cinder] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:23.346862 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faa17c-9e3b-4aa0-a393-9eef84a5a947 service cinder] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:23.347118 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faa17c-9e3b-4aa0-a393-9eef84a5a947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:23.356793 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faa17c-9e3b-4aa0-a393-9eef84a5a947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:23.358226 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faa17c-9e3b-4aa0-a393-9eef84a5a947 service cinder] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:23.368017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1416/2830] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:57:23 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:57:30.018094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc89c4a-d793-4882-be8a-21a989127449 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:30.020842 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2dc89c4a-d793-4882-be8a-21a989127449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:30.086384 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc89c4a-d793-4882-be8a-21a989127449 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:30.090744 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92599710-b111-4991-afa9-c2e7435cd004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:30.091398 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599710-b111-4991-afa9-c2e7435cd004 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:30.091680 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599710-b111-4991-afa9-c2e7435cd004 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:30.091959 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92599710-b111-4991-afa9-c2e7435cd004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:30.094001 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-92599710-b111-4991-afa9-c2e7435cd004 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:30.176907 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92599710-b111-4991-afa9-c2e7435cd004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:30.178267 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92599710-b111-4991-afa9-c2e7435cd004 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:30.188394 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1415/2831] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:57:30 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:57:31.420763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faa17c-9e3b-4aa0-a393-9eef84a5a947 service cinder] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:31.484207 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faa17c-9e3b-4aa0-a393-9eef84a5a947 service cinder] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:31.489431 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:31.490300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:31.490577 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:31.490845 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] PATH_INFO: `/v3/users/37e3388b24494903a8a6eb1dda6988cc` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:31.492048 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e3388b24494903a8a6eb1dda6988cc)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:31.494136 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:31.542244 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e3388b24494903a8a6eb1dda6988cc'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:31.553736 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e3388b24494903a8a6eb1dda6988cc'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:31.554463 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e3388b24494903a8a6eb1dda6988cc'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:31.561182 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e3388b24494903a8a6eb1dda6988cc'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:31.569312 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e3388b24494903a8a6eb1dda6988cc'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:31.576432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1417/2832] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:57:31 2021] DELETE /identity/v3/users/37e3388b24494903a8a6eb1dda6988cc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:57:31.581551 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3491903-a6b4-478a-aed2-74e82f559306 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:31.582076 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3491903-a6b4-478a-aed2-74e82f559306 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:31.582176 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3491903-a6b4-478a-aed2-74e82f559306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:31.600531 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-e3491903-a6b4-478a-aed2-74e82f559306 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:57:31.601773 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e3491903-a6b4-478a-aed2-74e82f559306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:31.663406 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1416/2833] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:57:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:57:31.673598 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:31.675083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:31.737196 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bf617-450e-4a69-a723-6f05b9fedf7d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:31.741215 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8db0b-688c-41ac-a037-9584089cb536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:31.741887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8db0b-688c-41ac-a037-9584089cb536 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:31.742176 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8db0b-688c-41ac-a037-9584089cb536 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:31.742432 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8db0b-688c-41ac-a037-9584089cb536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:31.752655 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8db0b-688c-41ac-a037-9584089cb536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:31.754271 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8db0b-688c-41ac-a037-9584089cb536 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:31.764269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1418/2834] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:57:31 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:57:32.033772 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3491903-a6b4-478a-aed2-74e82f559306 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:32.036663 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-e3491903-a6b4-478a-aed2-74e82f559306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:32.049333 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3491903-a6b4-478a-aed2-74e82f559306 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:32.054355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:32.055355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:32.055703 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:32.056035 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] PATH_INFO: `/v3/projects/cd4fe18b4c364f05a6910c285913dd0f` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:32.057459 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4fe18b4c364f05a6910c285913dd0f)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:32.059459 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:32.116134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4fe18b4c364f05a6910c285913dd0f', 'request_id': 'req-894bac3c-590e-4d19-9c6c-0f0696b5faa9'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:32.125301 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4fe18b4c364f05a6910c285913dd0f', 'request_id': 'req-894bac3c-590e-4d19-9c6c-0f0696b5faa9'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:32.134891 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4fe18b4c364f05a6910c285913dd0f', 'request_id': 'req-894bac3c-590e-4d19-9c6c-0f0696b5faa9'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:32.148674 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] The token cache is being invalidate because project cd4fe18b4c364f05a6910c285913dd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:57:32.148967 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:32.149776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:32.156631 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1417/2835] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:57:32 2021] DELETE /identity/v3/projects/cd4fe18b4c364f05a6910c285913dd0f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:57:55.631788 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8db0b-688c-41ac-a037-9584089cb536 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:55.633319 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9ee8db0b-688c-41ac-a037-9584089cb536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:55.647491 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8db0b-688c-41ac-a037-9584089cb536 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:55.722959 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:55.723861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:55.724305 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:55.724606 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] PATH_INFO: `/v3/users/ec44be0e26b44a55910bdccc7c836d2b` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:55.726314 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec44be0e26b44a55910bdccc7c836d2b)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:55.728739 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:55.780743 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec44be0e26b44a55910bdccc7c836d2b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:55.792528 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec44be0e26b44a55910bdccc7c836d2b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:55.793273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec44be0e26b44a55910bdccc7c836d2b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:55.800831 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec44be0e26b44a55910bdccc7c836d2b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:55.811235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec44be0e26b44a55910bdccc7c836d2b'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:55.818170 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1419/2836] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:57:55 2021] DELETE /identity/v3/users/ec44be0e26b44a55910bdccc7c836d2b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:57:55.998039 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:55.999624 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:56.013378 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bac3c-590e-4d19-9c6c-0f0696b5faa9 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:56.080440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:56.081363 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:56.081637 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:56.081904 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] PATH_INFO: `/v3/projects/979a51fd9c744bc9a5b0d82595603a56` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:56.083209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=979a51fd9c744bc9a5b0d82595603a56)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:56.085157 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:56.136563 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979a51fd9c744bc9a5b0d82595603a56', 'request_id': 'req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.145783 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979a51fd9c744bc9a5b0d82595603a56', 'request_id': 'req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.152546 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979a51fd9c744bc9a5b0d82595603a56', 'request_id': 'req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.164354 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] The token cache is being invalidate because project 979a51fd9c744bc9a5b0d82595603a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:57:56.164671 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.165976 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.167572 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1418/2837] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:57:55 2021] DELETE /identity/v3/projects/979a51fd9c744bc9a5b0d82595603a56 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:57:56.171852 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:56.173402 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:56.186481 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b39b73-8c3d-4514-9f9f-33e0a8efcf3a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:56.253143 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:56.254023 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:56.254300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:56.254569 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] PATH_INFO: `/v3/users/bf9a2635c7914d6ba75243201e08c936` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:56.255802 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9a2635c7914d6ba75243201e08c936)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:56.257840 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:56.309891 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9a2635c7914d6ba75243201e08c936'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.321947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9a2635c7914d6ba75243201e08c936'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.322629 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9a2635c7914d6ba75243201e08c936'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.329346 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9a2635c7914d6ba75243201e08c936'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.338398 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9a2635c7914d6ba75243201e08c936'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.344413 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1420/2838] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:57:56 2021] DELETE /identity/v3/users/bf9a2635c7914d6ba75243201e08c936 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:57:56.521779 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:57:56.523397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:57:56.538051 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b8de9-3854-40ec-bec5-2b3a8e641fb8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:57:56.597586 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:57:56.598510 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:57:56.598782 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:57:56.599049 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] PATH_INFO: `/v3/projects/8048e83ece8540b3956c273f439e5688` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:57:56.600391 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8048e83ece8540b3956c273f439e5688)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:57:56.602763 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:57:56.652874 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8048e83ece8540b3956c273f439e5688', 'request_id': 'req-c9d5f247-26d2-4e9e-a44d-114f9c21d675'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.663199 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8048e83ece8540b3956c273f439e5688', 'request_id': 'req-c9d5f247-26d2-4e9e-a44d-114f9c21d675'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.669549 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8048e83ece8540b3956c273f439e5688', 'request_id': 'req-c9d5f247-26d2-4e9e-a44d-114f9c21d675'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.679862 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] The token cache is being invalidate because project 8048e83ece8540b3956c273f439e5688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:57:56.680145 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.680965 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:57:56.682529 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1419/2839] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:57:56 2021] DELETE /identity/v3/projects/8048e83ece8540b3956c273f439e5688 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:58:35.968083 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:35.970653 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:36.040311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4daa3e-a772-43fa-a5ec-03553207c7fa admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:36.095987 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcbf68c-2ed9-4a25-8a66-34f7dfb6940a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:36.096672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbf68c-2ed9-4a25-8a66-34f7dfb6940a service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:36.097003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbf68c-2ed9-4a25-8a66-34f7dfb6940a service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:36.097274 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbf68c-2ed9-4a25-8a66-34f7dfb6940a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:36.099593 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-9bcbf68c-2ed9-4a25-8a66-34f7dfb6940a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:36.168966 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbf68c-2ed9-4a25-8a66-34f7dfb6940a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:36.170487 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcbf68c-2ed9-4a25-8a66-34f7dfb6940a service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:36.181237 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1421/2840] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:58:35 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:58:41.989909 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:41.992246 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:42.009481 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d5f247-26d2-4e9e-a44d-114f9c21d675 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:42.015351 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e77b2-1130-42a4-b171-40255f26d4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:42.016253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e77b2-1130-42a4-b171-40255f26d4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:42.016913 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e77b2-1130-42a4-b171-40255f26d4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:42.017214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e77b2-1130-42a4-b171-40255f26d4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:42.020034 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-723e77b2-1130-42a4-b171-40255f26d4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:42.038634 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e77b2-1130-42a4-b171-40255f26d4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:42.040079 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e77b2-1130-42a4-b171-40255f26d4c3 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:42.053217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1420/2841] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:58:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:58:44.422624 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57a26f-2773-432d-aeb0-38f849ac5b08 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:44.423172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57a26f-2773-432d-aeb0-38f849ac5b08 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:44.423172 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57a26f-2773-432d-aeb0-38f849ac5b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:44.442363 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-ca57a26f-2773-432d-aeb0-38f849ac5b08 None None] MFA Rules not processed for user `a541eff61b694cfab57bd9be29628a25`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:58:44.443539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ca57a26f-2773-432d-aeb0-38f849ac5b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:44.509126 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1422/2842] 10.222.0.62 () {58 vars in 967 bytes} [Mon Dec 13 16:58:44 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:58:44.553232 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e77b2-1130-42a4-b171-40255f26d4c3 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:44.555799 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-723e77b2-1130-42a4-b171-40255f26d4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:44.645104 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e77b2-1130-42a4-b171-40255f26d4c3 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:44.653944 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d268195-b4d4-4349-b9cf-64b19badf000 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '940c2c607c7b4f949593791360f99fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:44.654978 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d268195-b4d4-4349-b9cf-64b19badf000 service swift] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:44.655324 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d268195-b4d4-4349-b9cf-64b19badf000 service swift] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:44.655657 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d268195-b4d4-4349-b9cf-64b19badf000 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:44.666681 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d268195-b4d4-4349-b9cf-64b19badf000 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:44.668283 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d268195-b4d4-4349-b9cf-64b19badf000 service swift] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:44.676587 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1421/2843] 10.222.0.62 () {60 vars in 1384 bytes} [Mon Dec 13 16:58:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Dec 13 16:58:51.670767 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57a26f-2773-432d-aeb0-38f849ac5b08 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:51.672485 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ca57a26f-2773-432d-aeb0-38f849ac5b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:51.751784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57a26f-2773-432d-aeb0-38f849ac5b08 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:51.757087 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:51.757967 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:51.758245 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:51.758517 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] PATH_INFO: `/v3/users/9305e888877a4b799a83a512007958ab` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:51.759794 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9305e888877a4b799a83a512007958ab)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:51.761808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:51.820912 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9305e888877a4b799a83a512007958ab'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:51.838120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9305e888877a4b799a83a512007958ab'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:51.838858 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9305e888877a4b799a83a512007958ab'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:51.846425 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9305e888877a4b799a83a512007958ab'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:51.857484 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9305e888877a4b799a83a512007958ab'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:51.864243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1423/2844] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:58:51 2021] DELETE /identity/v3/users/9305e888877a4b799a83a512007958ab => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:58:52.039925 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d268195-b4d4-4349-b9cf-64b19badf000 service swift] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:52.051513 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d268195-b4d4-4349-b9cf-64b19badf000 service swift] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:52.111440 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:52.112307 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:52.112595 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:52.113443 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] PATH_INFO: `/v3/projects/a17cfb32dc2b4830a07073b1bb4f821e` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:52.114655 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17cfb32dc2b4830a07073b1bb4f821e)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:52.116555 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:52.163132 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17cfb32dc2b4830a07073b1bb4f821e', 'request_id': 'req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.172077 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17cfb32dc2b4830a07073b1bb4f821e', 'request_id': 'req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.179209 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17cfb32dc2b4830a07073b1bb4f821e', 'request_id': 'req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.189545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] The token cache is being invalidate because project a17cfb32dc2b4830a07073b1bb4f821e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:58:52.189831 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.190506 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.192153 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1422/2845] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:58:52 2021] DELETE /identity/v3/projects/a17cfb32dc2b4830a07073b1bb4f821e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:58:52.196601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:52.198456 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:52.211887 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a9929-de74-4af9-81a6-f0e7e9fb24c1 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:52.271197 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df987f26-f989-4704-8c96-c4272391c6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:52.272080 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df987f26-f989-4704-8c96-c4272391c6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:52.272362 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df987f26-f989-4704-8c96-c4272391c6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:52.272786 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df987f26-f989-4704-8c96-c4272391c6f8 admin admin] PATH_INFO: `/v3/users/1fa841988d2d4f44b9d4832f3cbd7a6c` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:52.274041 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df987f26-f989-4704-8c96-c4272391c6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa841988d2d4f44b9d4832f3cbd7a6c)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:52.276026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df987f26-f989-4704-8c96-c4272391c6f8 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:52.325588 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-df987f26-f989-4704-8c96-c4272391c6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa841988d2d4f44b9d4832f3cbd7a6c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.339569 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-df987f26-f989-4704-8c96-c4272391c6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa841988d2d4f44b9d4832f3cbd7a6c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.340443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-df987f26-f989-4704-8c96-c4272391c6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa841988d2d4f44b9d4832f3cbd7a6c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.349504 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-df987f26-f989-4704-8c96-c4272391c6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa841988d2d4f44b9d4832f3cbd7a6c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.359667 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-df987f26-f989-4704-8c96-c4272391c6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa841988d2d4f44b9d4832f3cbd7a6c'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.366340 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1424/2846] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 16:58:52 2021] DELETE /identity/v3/users/1fa841988d2d4f44b9d4832f3cbd7a6c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:58:52.562225 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:52.563642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:52.576007 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4d9f67-e0c3-48b5-a515-0d12fcee5ccf admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:52.636302 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:52.637256 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:52.637541 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:52.637947 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] PATH_INFO: `/v3/projects/cabe7ad06f134bc380218a457a669798` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:52.639288 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cabe7ad06f134bc380218a457a669798)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:52.641262 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:52.694468 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cabe7ad06f134bc380218a457a669798', 'request_id': 'req-369cb1e8-e2fe-4d26-af69-d534faf4dc60'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.704193 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cabe7ad06f134bc380218a457a669798', 'request_id': 'req-369cb1e8-e2fe-4d26-af69-d534faf4dc60'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.710895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cabe7ad06f134bc380218a457a669798', 'request_id': 'req-369cb1e8-e2fe-4d26-af69-d534faf4dc60'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.721367 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] The token cache is being invalidate because project cabe7ad06f134bc380218a457a669798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 16:58:52.721649 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.722328 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-369cb1e8-e2fe-4d26-af69-d534faf4dc60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 16:58:52.724495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1423/2847] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 16:58:52 2021] DELETE /identity/v3/projects/cabe7ad06f134bc380218a457a669798 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:58:52.731159 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dc64b-9f37-4b4d-816e-d980a7819c6a None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:52.731677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dc64b-9f37-4b4d-816e-d980a7819c6a None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:52.731677 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dc64b-9f37-4b4d-816e-d980a7819c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:52.751060 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-644dc64b-9f37-4b4d-816e-d980a7819c6a None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:58:52.752248 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-644dc64b-9f37-4b4d-816e-d980a7819c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:52.817411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1425/2848] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:58:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 16:58:52.826449 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3536b48-26bb-48d6-81d9-38ea9d6afb95 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:52.826776 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3536b48-26bb-48d6-81d9-38ea9d6afb95 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:52.827095 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3536b48-26bb-48d6-81d9-38ea9d6afb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:52.848021 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-a3536b48-26bb-48d6-81d9-38ea9d6afb95 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:58:52.849593 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a3536b48-26bb-48d6-81d9-38ea9d6afb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:52.857725 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1424/2849] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:58:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:58:52.862662 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644dc64b-9f37-4b4d-816e-d980a7819c6a None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:52.878434 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644dc64b-9f37-4b4d-816e-d980a7819c6a None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:52.884304 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92fe2-ea3f-4b0d-9577-a15e2741a025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:52.885001 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92fe2-ea3f-4b0d-9577-a15e2741a025 admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:52.885279 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92fe2-ea3f-4b0d-9577-a15e2741a025 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:52.885550 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c92fe2-ea3f-4b0d-9577-a15e2741a025 admin admin] PATH_INFO: `/v3/domains` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:52.886284 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92fe2-ea3f-4b0d-9577-a15e2741a025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86095) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Dec 13 16:58:52.886590 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92fe2-ea3f-4b0d-9577-a15e2741a025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:52.888191 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c92fe2-ea3f-4b0d-9577-a15e2741a025 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:52.900699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1426/2850] 10.222.0.62 () {58 vars in 1152 bytes} [Mon Dec 13 16:58:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Dec 13 16:58:52.907031 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3536b48-26bb-48d6-81d9-38ea9d6afb95 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:52.918537 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3536b48-26bb-48d6-81d9-38ea9d6afb95 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:52.924603 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f45b18-6983-47ef-abe5-e17102b755c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:52.925261 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f45b18-6983-47ef-abe5-e17102b755c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:52.925539 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f45b18-6983-47ef-abe5-e17102b755c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:52.925973 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f45b18-6983-47ef-abe5-e17102b755c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:52.927115 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f45b18-6983-47ef-abe5-e17102b755c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:52.929092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f45b18-6983-47ef-abe5-e17102b755c4 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:52.960956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1425/2851] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:58:52 2021] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:58:52.965371 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92fe2-ea3f-4b0d-9577-a15e2741a025 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:52.975939 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c92fe2-ea3f-4b0d-9577-a15e2741a025 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:53.037035 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c73f5-393b-4697-bada-19e1bd48c083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:53.037726 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c73f5-393b-4697-bada-19e1bd48c083 admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:53.038010 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c73f5-393b-4697-bada-19e1bd48c083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:53.038285 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c73f5-393b-4697-bada-19e1bd48c083 admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:53.039000 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c73f5-393b-4697-bada-19e1bd48c083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:53.040956 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3c73f5-393b-4697-bada-19e1bd48c083 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:53.064033 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1427/2852] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:58:52 2021] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:58:53.069244 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f45b18-6983-47ef-abe5-e17102b755c4 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:53.079687 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f45b18-6983-47ef-abe5-e17102b755c4 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:53.085436 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc005a-4b31-4b0b-9fd9-12f65b751f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:53.086098 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc005a-4b31-4b0b-9fd9-12f65b751f1e admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:53.086374 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc005a-4b31-4b0b-9fd9-12f65b751f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:53.086642 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc005a-4b31-4b0b-9fd9-12f65b751f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:53.087376 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc005a-4b31-4b0b-9fd9-12f65b751f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:53.089033 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc005a-4b31-4b0b-9fd9-12f65b751f1e admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:53.100548 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1426/2853] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:58:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:58:53.105419 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c73f5-393b-4697-bada-19e1bd48c083 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:53.117214 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c73f5-393b-4697-bada-19e1bd48c083 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:53.122253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f020e2-bca6-4b9f-860d-02f87e986fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:53.122922 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f020e2-bca6-4b9f-860d-02f87e986fcb admin admin] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:53.123196 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f020e2-bca6-4b9f-860d-02f87e986fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:53.123468 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f020e2-bca6-4b9f-860d-02f87e986fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:53.124393 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f020e2-bca6-4b9f-860d-02f87e986fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:53.126029 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f020e2-bca6-4b9f-860d-02f87e986fcb admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:53.141240 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1428/2854] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:58:53 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:58:53.146181 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc005a-4b31-4b0b-9fd9-12f65b751f1e admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:53.157226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc005a-4b31-4b0b-9fd9-12f65b751f1e admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:53.163453 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f48a0b-ebd7-45db-8ea7-e69cfdf8406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:53.164337 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f48a0b-ebd7-45db-8ea7-e69cfdf8406f admin admin] REQUEST_METHOD: `PUT` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:53.164643 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f48a0b-ebd7-45db-8ea7-e69cfdf8406f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:53.164920 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f48a0b-ebd7-45db-8ea7-e69cfdf8406f admin admin] PATH_INFO: `/v3/projects/8a3d44ae5b7a42349c31171119f79b12/users/078365e1f861436ba3fc141bf3503ea6/roles/13af8820459545b2b1e4cea1afea8775` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:53.179803 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f48a0b-ebd7-45db-8ea7-e69cfdf8406f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3d44ae5b7a42349c31171119f79b12, user_id=078365e1f861436ba3fc141bf3503ea6, role_id=13af8820459545b2b1e4cea1afea8775)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:53.182500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f48a0b-ebd7-45db-8ea7-e69cfdf8406f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:53.203325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1427/2855] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:58:53 2021] PUT /identity/v3/projects/8a3d44ae5b7a42349c31171119f79b12/users/078365e1f861436ba3fc141bf3503ea6/roles/13af8820459545b2b1e4cea1afea8775 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:58:53.211453 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67442c-5b82-4ee4-9dc7-4c2239682363 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:53.211875 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67442c-5b82-4ee4-9dc7-4c2239682363 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:53.212269 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67442c-5b82-4ee4-9dc7-4c2239682363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:53.238801 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-ab67442c-5b82-4ee4-9dc7-4c2239682363 None None] MFA Rules not processed for user `bc88850011704653a832fe050d8d83ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:58:53.239999 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ab67442c-5b82-4ee4-9dc7-4c2239682363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:53.310601 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1429/2856] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:58:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:58:53.320921 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f48a0b-ebd7-45db-8ea7-e69cfdf8406f admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:53.322806 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-c1f48a0b-ebd7-45db-8ea7-e69cfdf8406f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:53.393327 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f48a0b-ebd7-45db-8ea7-e69cfdf8406f admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:53.398559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5026e-2b23-40e1-ad24-9d4e62e5b437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:53.399217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5026e-2b23-40e1-ad24-9d4e62e5b437 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:53.399485 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5026e-2b23-40e1-ad24-9d4e62e5b437 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:53.399746 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5026e-2b23-40e1-ad24-9d4e62e5b437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:53.409612 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5026e-2b23-40e1-ad24-9d4e62e5b437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:53.411217 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5026e-2b23-40e1-ad24-9d4e62e5b437 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:53.421836 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1428/2857] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:58:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:58:57.738013 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003252-a39f-404e-b96a-8ef782ea40df None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:57.738561 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003252-a39f-404e-b96a-8ef782ea40df None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:57.739562 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1003252-a39f-404e-b96a-8ef782ea40df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:57.772324 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-b1003252-a39f-404e-b96a-8ef782ea40df None None] MFA Rules not processed for user `078365e1f861436ba3fc141bf3503ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:58:57.773719 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-b1003252-a39f-404e-b96a-8ef782ea40df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:58:57.844138 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1430/2858] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:58:57 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:58:57.849189 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5026e-2b23-40e1-ad24-9d4e62e5b437 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:57.859793 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5026e-2b23-40e1-ad24-9d4e62e5b437 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:57.864869 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4187e-d9da-44bc-add8-efc238ef0da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:57.865575 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4187e-d9da-44bc-add8-efc238ef0da7 admin admin] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:57.865863 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4187e-d9da-44bc-add8-efc238ef0da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:57.866141 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4187e-d9da-44bc-add8-efc238ef0da7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:57.866856 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4187e-d9da-44bc-add8-efc238ef0da7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:57.868808 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4187e-d9da-44bc-add8-efc238ef0da7 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:57.899991 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1429/2859] 10.222.0.62 () {60 vars in 1152 bytes} [Mon Dec 13 16:58:57 2021] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:58:57.901206 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1003252-a39f-404e-b96a-8ef782ea40df None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:57.912686 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1003252-a39f-404e-b96a-8ef782ea40df None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:57.970485 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b59e7-4444-4859-9465-7948cf9a398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:57.971167 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b59e7-4444-4859-9465-7948cf9a398d admin admin] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:57.971444 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b59e7-4444-4859-9465-7948cf9a398d admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:57.971715 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b59e7-4444-4859-9465-7948cf9a398d admin admin] PATH_INFO: `/v3/users` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:57.972411 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b59e7-4444-4859-9465-7948cf9a398d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:57.974854 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b59e7-4444-4859-9465-7948cf9a398d admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:57.996991 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1431/2860] 10.222.0.62 () {60 vars in 1143 bytes} [Mon Dec 13 16:58:57 2021] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Dec 13 16:58:58.001048 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4187e-d9da-44bc-add8-efc238ef0da7 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:58.012325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4187e-d9da-44bc-add8-efc238ef0da7 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:58.017028 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383ebc9-3844-412a-a0db-9f9ef51a44a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:58.017701 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383ebc9-3844-412a-a0db-9f9ef51a44a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:58.017980 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383ebc9-3844-412a-a0db-9f9ef51a44a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:58.018251 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383ebc9-3844-412a-a0db-9f9ef51a44a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:58.018993 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383ebc9-3844-412a-a0db-9f9ef51a44a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:58.020778 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383ebc9-3844-412a-a0db-9f9ef51a44a8 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:58.031818 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1430/2861] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:58:57 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:58:58.036351 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b59e7-4444-4859-9465-7948cf9a398d admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:58.046529 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b59e7-4444-4859-9465-7948cf9a398d admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:58.051454 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cb7dc-3fcf-4348-ae02-4758746b3c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:58.052527 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cb7dc-3fcf-4348-ae02-4758746b3c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:58.052848 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cb7dc-3fcf-4348-ae02-4758746b3c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:58.053120 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cb7dc-3fcf-4348-ae02-4758746b3c5a admin admin] PATH_INFO: `/v3/projects/535bda0c85c04017a6e3dca9f5466ab7/users/2a6605dea81048da9c38fac08c0a2bc9/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:58.071022 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cb7dc-3fcf-4348-ae02-4758746b3c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=535bda0c85c04017a6e3dca9f5466ab7, user_id=2a6605dea81048da9c38fac08c0a2bc9, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:58.074105 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388cb7dc-3fcf-4348-ae02-4758746b3c5a admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:58.089026 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1432/2862] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:58:58 2021] PUT /identity/v3/projects/535bda0c85c04017a6e3dca9f5466ab7/users/2a6605dea81048da9c38fac08c0a2bc9/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 16:58:58.093059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383ebc9-3844-412a-a0db-9f9ef51a44a8 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:58.103985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383ebc9-3844-412a-a0db-9f9ef51a44a8 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:58.176297 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18153b-a08c-49c0-99d9-0ce6acc3a18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:58.177112 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18153b-a08c-49c0-99d9-0ce6acc3a18f admin admin] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:58.177388 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18153b-a08c-49c0-99d9-0ce6acc3a18f admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:58.177654 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18153b-a08c-49c0-99d9-0ce6acc3a18f admin admin] PATH_INFO: `/v3/roles` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:58.178397 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18153b-a08c-49c0-99d9-0ce6acc3a18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:58.180005 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18153b-a08c-49c0-99d9-0ce6acc3a18f admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:58.190466 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1431/2863] 10.222.0.62 () {58 vars in 1121 bytes} [Mon Dec 13 16:58:58 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Dec 13 16:58:58.195067 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cb7dc-3fcf-4348-ae02-4758746b3c5a admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:58:58.206214 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cb7dc-3fcf-4348-ae02-4758746b3c5a admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:58:58.213689 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d43854-0674-4327-b561-b55dc5369f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:58:58.214699 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d43854-0674-4327-b561-b55dc5369f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:58:58.215052 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d43854-0674-4327-b561-b55dc5369f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:58:58.215390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d43854-0674-4327-b561-b55dc5369f21 admin admin] PATH_INFO: `/v3/projects/535bda0c85c04017a6e3dca9f5466ab7/users/2a6605dea81048da9c38fac08c0a2bc9/roles/f3311ba27a464113b884aa5a1144945d` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:58:58.217721 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d43854-0674-4327-b561-b55dc5369f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535bda0c85c04017a6e3dca9f5466ab7, user_id=2a6605dea81048da9c38fac08c0a2bc9, role_id=f3311ba27a464113b884aa5a1144945d)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:58:58.220373 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d43854-0674-4327-b561-b55dc5369f21 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:58:58.232264 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1433/2864] 10.222.0.62 () {60 vars in 1482 bytes} [Mon Dec 13 16:58:58 2021] PUT /identity/v3/projects/535bda0c85c04017a6e3dca9f5466ab7/users/2a6605dea81048da9c38fac08c0a2bc9/roles/f3311ba27a464113b884aa5a1144945d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Dec 13 16:59:02.357922 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf838b57-a76c-4cb4-8dd0-07439732adce None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:59:02.358644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf838b57-a76c-4cb4-8dd0-07439732adce None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:59:02.358644 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf838b57-a76c-4cb4-8dd0-07439732adce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:59:02.384895 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-bf838b57-a76c-4cb4-8dd0-07439732adce None None] MFA Rules not processed for user `2a6605dea81048da9c38fac08c0a2bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:59:02.386105 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-bf838b57-a76c-4cb4-8dd0-07439732adce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:59:02.460203 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1432/2865] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:59:02 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:59:02.471948 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d43854-0674-4327-b561-b55dc5369f21 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:59:02.474350 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-e3d43854-0674-4327-b561-b55dc5369f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:59:02.551547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d43854-0674-4327-b561-b55dc5369f21 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:59:02.557782 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ac7ec-0167-4209-a8e7-fed8b87c8179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:59:02.558438 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ac7ec-0167-4209-a8e7-fed8b87c8179 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:59:02.558710 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ac7ec-0167-4209-a8e7-fed8b87c8179 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:59:02.559003 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ac7ec-0167-4209-a8e7-fed8b87c8179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:59:02.617209 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ac7ec-0167-4209-a8e7-fed8b87c8179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:59:02.618825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ac7ec-0167-4209-a8e7-fed8b87c8179 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:59:02.628031 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1434/2866] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:59:02 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:59:19.276123 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d711dd-6d79-400f-b786-646ae02f7190 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:59:19.276713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d711dd-6d79-400f-b786-646ae02f7190 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:59:19.276713 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d711dd-6d79-400f-b786-646ae02f7190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:59:19.294400 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-63d711dd-6d79-400f-b786-646ae02f7190 None None] MFA Rules not processed for user `078365e1f861436ba3fc141bf3503ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 16:59:19.295605 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-63d711dd-6d79-400f-b786-646ae02f7190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:59:19.303834 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1433/2867] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 16:59:19 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 16:59:21.142516 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ac7ec-0167-4209-a8e7-fed8b87c8179 service nova] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:59:21.144936 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-995ac7ec-0167-4209-a8e7-fed8b87c8179 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:59:21.219808 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ac7ec-0167-4209-a8e7-fed8b87c8179 service nova] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:59:21.228865 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef5a1c-09a4-4fc0-9780-20b04a3fa6c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b7187c26dd41bea9f3c2b49de8ef28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:59:21.229734 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef5a1c-09a4-4fc0-9780-20b04a3fa6c9 service placement] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:59:21.230121 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef5a1c-09a4-4fc0-9780-20b04a3fa6c9 service placement] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:59:21.230459 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef5a1c-09a4-4fc0-9780-20b04a3fa6c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:59:21.232915 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-8bef5a1c-09a4-4fc0-9780-20b04a3fa6c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:59:21.245708 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef5a1c-09a4-4fc0-9780-20b04a3fa6c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:59:21.247321 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef5a1c-09a4-4fc0-9780-20b04a3fa6c9 service placement] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:59:21.257614 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1435/2868] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:59:21 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:59:23.029356 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d711dd-6d79-400f-b786-646ae02f7190 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:59:23.090147 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d711dd-6d79-400f-b786-646ae02f7190 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:59:23.093932 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c41c7-7a15-48f3-b4f0-eaf624845b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:59:23.094606 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c41c7-7a15-48f3-b4f0-eaf624845b88 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:59:23.094918 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c41c7-7a15-48f3-b4f0-eaf624845b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:59:23.095193 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c41c7-7a15-48f3-b4f0-eaf624845b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:59:23.097226 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-767c41c7-7a15-48f3-b4f0-eaf624845b88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:59:23.108355 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c41c7-7a15-48f3-b4f0-eaf624845b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:59:23.109777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c41c7-7a15-48f3-b4f0-eaf624845b88 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:59:23.118133 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1434/2869] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:59:23 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:59:24.037081 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef5a1c-09a4-4fc0-9780-20b04a3fa6c9 service placement] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:59:24.039619 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-8bef5a1c-09a4-4fc0-9780-20b04a3fa6c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:59:24.064547 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef5a1c-09a4-4fc0-9780-20b04a3fa6c9 service placement] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:59:24.070765 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853963ee-516d-4fdf-af92-c026b206609d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:59:24.071482 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853963ee-516d-4fdf-af92-c026b206609d service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:59:24.071763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853963ee-516d-4fdf-af92-c026b206609d service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:59:24.072216 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853963ee-516d-4fdf-af92-c026b206609d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:59:24.074188 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-853963ee-516d-4fdf-af92-c026b206609d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:59:24.087731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853963ee-516d-4fdf-af92-c026b206609d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:59:24.089587 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853963ee-516d-4fdf-af92-c026b206609d service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:59:24.102750 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1436/2870] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:59:24 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:59:34.046762 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c41c7-7a15-48f3-b4f0-eaf624845b88 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:59:34.064009 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c41c7-7a15-48f3-b4f0-eaf624845b88 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:59:34.070099 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dceea5e-cc1f-4c5e-b43b-a7ae778b465f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:59:34.070861 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceea5e-cc1f-4c5e-b43b-a7ae778b465f service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:59:34.071214 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceea5e-cc1f-4c5e-b43b-a7ae778b465f service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:59:34.071559 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dceea5e-cc1f-4c5e-b43b-a7ae778b465f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:59:34.074329 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-2dceea5e-cc1f-4c5e-b43b-a7ae778b465f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:59:34.090313 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dceea5e-cc1f-4c5e-b43b-a7ae778b465f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:59:34.092116 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dceea5e-cc1f-4c5e-b43b-a7ae778b465f service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:59:34.103777 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1435/2871] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:59:34 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:59:36.790408 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853963ee-516d-4fdf-af92-c026b206609d service nova] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:59:36.792146 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-853963ee-516d-4fdf-af92-c026b206609d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:59:36.804535 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853963ee-516d-4fdf-af92-c026b206609d service nova] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:59:36.808928 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749d3a4-86ef-4562-bc0d-8a297ebf107f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:59:36.809771 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749d3a4-86ef-4562-bc0d-8a297ebf107f service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:59:36.810049 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749d3a4-86ef-4562-bc0d-8a297ebf107f service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:59:36.810316 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749d3a4-86ef-4562-bc0d-8a297ebf107f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:59:36.820386 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749d3a4-86ef-4562-bc0d-8a297ebf107f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:59:36.821847 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749d3a4-86ef-4562-bc0d-8a297ebf107f service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:59:36.831648 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1437/2872] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:59:36 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 16:59:38.535250 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dceea5e-cc1f-4c5e-b43b-a7ae778b465f service nova] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 16:59:38.547602 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dceea5e-cc1f-4c5e-b43b-a7ae778b465f service nova] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 16:59:38.553554 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02849f9-cd63-4d57-9f2c-d009d38ddd81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 16:59:38.554272 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02849f9-cd63-4d57-9f2c-d009d38ddd81 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 16:59:38.554547 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02849f9-cd63-4d57-9f2c-d009d38ddd81 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 16:59:38.554820 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02849f9-cd63-4d57-9f2c-d009d38ddd81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 16:59:38.556702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-a02849f9-cd63-4d57-9f2c-d009d38ddd81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 16:59:38.569580 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02849f9-cd63-4d57-9f2c-d009d38ddd81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 16:59:38.571179 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02849f9-cd63-4d57-9f2c-d009d38ddd81 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 16:59:38.582084 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1436/2873] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 16:59:38 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 17:01:37.446610 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79f715-f7d1-40f1-815a-6e4d3eafa591 None None] REQUEST_METHOD: `POST` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:01:37.447165 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79f715-f7d1-40f1-815a-6e4d3eafa591 None None] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:01:37.447273 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79f715-f7d1-40f1-815a-6e4d3eafa591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:01:37.479986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.auth.core [None req-dd79f715-f7d1-40f1-815a-6e4d3eafa591 None None] MFA Rules not processed for user `078365e1f861436ba3fc141bf3503ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=86095) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 17:01:37.481219 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-dd79f715-f7d1-40f1-815a-6e4d3eafa591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:01:37.506097 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1438/2874] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 17:01:37 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Dec 13 17:01:37.852532 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02849f9-cd63-4d57-9f2c-d009d38ddd81 service nova] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:01:37.890936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02849f9-cd63-4d57-9f2c-d009d38ddd81 service nova] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:01:37.894878 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789008f-77c7-4157-b193-838e81c54eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:01:37.895520 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789008f-77c7-4157-b193-838e81c54eef service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:01:37.895804 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789008f-77c7-4157-b193-838e81c54eef service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:01:37.896085 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789008f-77c7-4157-b193-838e81c54eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:01:37.898260 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-5789008f-77c7-4157-b193-838e81c54eef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:01:37.921495 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789008f-77c7-4157-b193-838e81c54eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:01:37.922940 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789008f-77c7-4157-b193-838e81c54eef service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:01:37.931694 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1437/2875] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 17:01:37 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 17:02:25.888058 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79f715-f7d1-40f1-815a-6e4d3eafa591 None None] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:02:25.918731 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79f715-f7d1-40f1-815a-6e4d3eafa591 None None] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:02:25.924539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fb1e3-6280-49d6-b607-76f26c40adda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b7187c26dd41bea9f3c2b49de8ef28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:02:25.925327 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb1e3-6280-49d6-b607-76f26c40adda service placement] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:02:25.925613 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb1e3-6280-49d6-b607-76f26c40adda service placement] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:02:25.925904 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb1e3-6280-49d6-b607-76f26c40adda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:02:25.927792 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-ff0fb1e3-6280-49d6-b607-76f26c40adda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:02:25.952225 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fb1e3-6280-49d6-b607-76f26c40adda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:02:25.953851 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fb1e3-6280-49d6-b607-76f26c40adda service placement] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:02:25.963823 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1439/2876] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 17:02:25 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 17:03:41.733436 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe46190-12b9-4c10-af09-2b35edd50d88 None None] REQUEST_METHOD: `POST` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:03:41.734059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe46190-12b9-4c10-af09-2b35edd50d88 None None] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:03:41.734059 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe46190-12b9-4c10-af09-2b35edd50d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:03:41.751892 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.auth.core [None req-fbe46190-12b9-4c10-af09-2b35edd50d88 None None] MFA Rules not processed for user `078365e1f861436ba3fc141bf3503ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=86094) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Dec 13 17:03:41.753525 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fbe46190-12b9-4c10-af09-2b35edd50d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:03:41.760219 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1438/2877] 10.222.0.62 () {58 vars in 957 bytes} [Mon Dec 13 17:03:41 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Dec 13 17:03:42.111464 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fb1e3-6280-49d6-b607-76f26c40adda service placement] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:03:42.126433 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fb1e3-6280-49d6-b607-76f26c40adda service placement] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:03:42.132911 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57fed-e668-49ae-9373-316340a6ca0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:03:42.133949 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57fed-e668-49ae-9373-316340a6ca0b service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:03:42.134320 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57fed-e668-49ae-9373-316340a6ca0b service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:03:42.134672 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe57fed-e668-49ae-9373-316340a6ca0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:03:42.137483 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-bfe57fed-e668-49ae-9373-316340a6ca0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:03:42.148752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe57fed-e668-49ae-9373-316340a6ca0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:03:42.150243 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe57fed-e668-49ae-9373-316340a6ca0b service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:03:42.159158 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1440/2878] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 17:03:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 17:03:42.485668 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe46190-12b9-4c10-af09-2b35edd50d88 None None] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:03:42.487303 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-fbe46190-12b9-4c10-af09-2b35edd50d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:03:42.577936 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe46190-12b9-4c10-af09-2b35edd50d88 None None] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:03:42.581986 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0f66d-b4bb-4cee-abf8-875cf2775747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20f42eb51a824f69a6f77c5044300da2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:03:42.582645 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0f66d-b4bb-4cee-abf8-875cf2775747 service cinder] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:03:42.582900 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0f66d-b4bb-4cee-abf8-875cf2775747 service cinder] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:03:42.583170 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0f66d-b4bb-4cee-abf8-875cf2775747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:03:42.585144 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-48d0f66d-b4bb-4cee-abf8-875cf2775747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:03:42.622535 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0f66d-b4bb-4cee-abf8-875cf2775747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:03:42.623985 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0f66d-b4bb-4cee-abf8-875cf2775747 service cinder] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:03:42.646705 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1439/2879] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 17:03:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 17:03:42.822231 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57fed-e668-49ae-9373-316340a6ca0b service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:03:42.830924 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe57fed-e668-49ae-9373-316340a6ca0b service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:03:42.834539 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16209781-9239-49b5-9891-6201bed4f0ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:03:42.835200 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209781-9239-49b5-9891-6201bed4f0ee service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:03:42.835480 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209781-9239-49b5-9891-6201bed4f0ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:03:42.835712 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16209781-9239-49b5-9891-6201bed4f0ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:03:42.837669 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-16209781-9239-49b5-9891-6201bed4f0ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:03:42.854401 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16209781-9239-49b5-9891-6201bed4f0ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:03:42.856117 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16209781-9239-49b5-9891-6201bed4f0ee service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:03:42.872986 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1441/2880] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 17:03:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 17:04:30.595514 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0f66d-b4bb-4cee-abf8-875cf2775747 service cinder] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:04:30.606323 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0f66d-b4bb-4cee-abf8-875cf2775747 service cinder] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:04:30.610956 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61367d5e-0ba3-404b-a2d0-465d7f5389fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:04:30.611972 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367d5e-0ba3-404b-a2d0-465d7f5389fc service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:04:30.612484 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367d5e-0ba3-404b-a2d0-465d7f5389fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:04:30.613012 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61367d5e-0ba3-404b-a2d0-465d7f5389fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:04:30.623063 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61367d5e-0ba3-404b-a2d0-465d7f5389fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:04:30.624503 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61367d5e-0ba3-404b-a2d0-465d7f5389fc service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:04:30.633043 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1440/2881] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 17:04:30 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 17:05:29.312216 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16209781-9239-49b5-9891-6201bed4f0ee service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:05:29.323030 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16209781-9239-49b5-9891-6201bed4f0ee service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:05:29.329752 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc89464-bc5f-41a6-963b-7657df1db972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:05:29.330707 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89464-bc5f-41a6-963b-7657df1db972 service neutron] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:05:29.331017 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89464-bc5f-41a6-963b-7657df1db972 service neutron] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:05:29.331311 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc89464-bc5f-41a6-963b-7657df1db972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:05:29.341760 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc89464-bc5f-41a6-963b-7657df1db972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:05:29.343209 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc89464-bc5f-41a6-963b-7657df1db972 service neutron] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:05:29.352895 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1442/2882] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 17:05:29 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 17:05:30.302570 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61367d5e-0ba3-404b-a2d0-465d7f5389fc service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:05:30.316638 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61367d5e-0ba3-404b-a2d0-465d7f5389fc service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:05:30.329337 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33c42b-523e-40c0-9008-ed7a982410b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:05:30.330004 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c42b-523e-40c0-9008-ed7a982410b5 service nova] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:05:30.330287 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c42b-523e-40c0-9008-ed7a982410b5 service nova] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:05:30.330545 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33c42b-523e-40c0-9008-ed7a982410b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:05:30.345244 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33c42b-523e-40c0-9008-ed7a982410b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:05:30.346814 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33c42b-523e-40c0-9008-ed7a982410b5 service nova] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:05:30.358186 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1441/2883] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 17:05:30 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 17:05:32.509280 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc89464-bc5f-41a6-963b-7657df1db972 service neutron] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:05:32.522390 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc89464-bc5f-41a6-963b-7657df1db972 service neutron] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:05:32.528656 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05527d-bc0e-4d46-a49a-c5d201c70128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfecc747eb8d431a8d57f4534d259de8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:05:32.529300 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05527d-bc0e-4d46-a49a-c5d201c70128 service nova] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:05:32.529572 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05527d-bc0e-4d46-a49a-c5d201c70128 service nova] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:05:32.529844 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05527d-bc0e-4d46-a49a-c5d201c70128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:05:32.539235 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05527d-bc0e-4d46-a49a-c5d201c70128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:05:32.540844 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05527d-bc0e-4d46-a49a-c5d201c70128 service nova] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:05:32.552193 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1443/2884] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 17:05:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 17:05:42.682215 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33c42b-523e-40c0-9008-ed7a982410b5 service nova] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:05:42.691699 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33c42b-523e-40c0-9008-ed7a982410b5 service nova] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:05:42.695155 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1118d-ae17-465f-a819-d565368a3a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51f9a10e3d87475e92fb49686f1aa456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:05:42.695782 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1118d-ae17-465f-a819-d565368a3a30 service neutron] REQUEST_METHOD: `GET` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:05:42.696057 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1118d-ae17-465f-a819-d565368a3a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:05:42.696325 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1118d-ae17-465f-a819-d565368a3a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:05:42.766173 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1118d-ae17-465f-a819-d565368a3a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:05:42.767630 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1118d-ae17-465f-a819-d565368a3a30 service neutron] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:05:42.786253 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1442/2885] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 17:05:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Dec 13 17:05:49.682825 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05527d-bc0e-4d46-a49a-c5d201c70128 service nova] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:05:49.694763 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05527d-bc0e-4d46-a49a-c5d201c70128 service nova] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:05:49.700532 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:05:49.701443 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:05:49.702067 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:05:49.702947 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] PATH_INFO: `/v3/users/078365e1f861436ba3fc141bf3503ea6` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:05:49.704833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=078365e1f861436ba3fc141bf3503ea6)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:05:49.707951 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:05:49.770557 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078365e1f861436ba3fc141bf3503ea6'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:49.782673 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078365e1f861436ba3fc141bf3503ea6'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:49.783497 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078365e1f861436ba3fc141bf3503ea6'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:49.790781 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078365e1f861436ba3fc141bf3503ea6'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:49.799796 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078365e1f861436ba3fc141bf3503ea6'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:49.805833 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1444/2886] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 17:05:49 2021] DELETE /identity/v3/users/078365e1f861436ba3fc141bf3503ea6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 17:05:49.979248 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1118d-ae17-465f-a819-d565368a3a30 service neutron] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:05:49.990943 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1118d-ae17-465f-a819-d565368a3a30 service neutron] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:05:50.047954 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:05:50.048857 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:05:50.049147 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:05:50.049420 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] PATH_INFO: `/v3/projects/8a3d44ae5b7a42349c31171119f79b12` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:05:50.050672 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3d44ae5b7a42349c31171119f79b12)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:05:50.052611 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:05:50.101183 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3d44ae5b7a42349c31171119f79b12', 'request_id': 'req-51779dc5-d8ca-4fb7-a4c4-391167947047'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.110121 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3d44ae5b7a42349c31171119f79b12', 'request_id': 'req-51779dc5-d8ca-4fb7-a4c4-391167947047'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.116134 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3d44ae5b7a42349c31171119f79b12', 'request_id': 'req-51779dc5-d8ca-4fb7-a4c4-391167947047'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.139282 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] The token cache is being invalidate because project 8a3d44ae5b7a42349c31171119f79b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 17:05:50.139812 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.140493 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.142094 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1443/2887] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 17:05:49 2021] DELETE /identity/v3/projects/8a3d44ae5b7a42349c31171119f79b12 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 17:05:50.146242 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:05:50.147784 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:05:50.161253 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a35e0-165b-418f-ab5b-bccfcc2c1e58 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:05:50.223984 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:05:50.224861 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:05:50.225162 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:05:50.225431 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] PATH_INFO: `/v3/users/2a6605dea81048da9c38fac08c0a2bc9` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:05:50.226657 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a6605dea81048da9c38fac08c0a2bc9)` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:05:50.228609 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:05:50.276328 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a6605dea81048da9c38fac08c0a2bc9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.288592 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a6605dea81048da9c38fac08c0a2bc9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.289265 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a6605dea81048da9c38fac08c0a2bc9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.296180 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a6605dea81048da9c38fac08c0a2bc9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.304142 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.notifications [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a6605dea81048da9c38fac08c0a2bc9'} {{(pid=86095) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.309896 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1445/2888] 10.222.0.62 () {58 vars in 1223 bytes} [Mon Dec 13 17:05:50 2021] DELETE /identity/v3/users/2a6605dea81048da9c38fac08c0a2bc9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 17:05:50.491229 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] Authenticating user token {{(pid=86094) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:05:50.492749 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.fernet_utils [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86094) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:05:50.505728 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51779dc5-d8ca-4fb7-a4c4-391167947047 admin admin] Validating token access rules against request {{(pid=86094) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:05:50.560404 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc88850011704653a832fe050d8d83ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad2f264c1784427a00af5662d2bd264', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86094) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:05:50.561483 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:05:50.561702 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:05:50.562113 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] PATH_INFO: `/v3/projects/535bda0c85c04017a6e3dca9f5466ab7` {{(pid=86094) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:05:50.563346 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535bda0c85c04017a6e3dca9f5466ab7)` {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:05:50.565276 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] RBAC: Authorization granted {{(pid=86094) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:05:50.613653 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535bda0c85c04017a6e3dca9f5466ab7', 'request_id': 'req-8880ab84-b34f-498d-9c29-655dd696ecb6'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.622901 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535bda0c85c04017a6e3dca9f5466ab7', 'request_id': 'req-8880ab84-b34f-498d-9c29-655dd696ecb6'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.629347 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535bda0c85c04017a6e3dca9f5466ab7', 'request_id': 'req-8880ab84-b34f-498d-9c29-655dd696ecb6'} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.639569 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] The token cache is being invalidate because project 535bda0c85c04017a6e3dca9f5466ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86094) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Dec 13 17:05:50.639883 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.640500 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: DEBUG keystone.notifications [None req-8880ab84-b34f-498d-9c29-655dd696ecb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86094) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Dec 13 17:05:50.642092 dv-cinder-821602-2-iscsi devstack@keystone.service[86094]: [pid: 86094|app: 0|req: 1444/2889] 10.222.0.62 () {58 vars in 1232 bytes} [Mon Dec 13 17:05:50 2021] DELETE /identity/v3/projects/535bda0c85c04017a6e3dca9f5466ab7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Dec 13 17:07:31.852335 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] Authenticating user token {{(pid=86095) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Dec 13 17:07:31.853909 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:07:31.934349 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b917d-67d6-4503-81bd-108ae3d9ac62 admin admin] Validating token access rules against request {{(pid=86095) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Dec 13 17:07:32.001989 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cc1c3-2675-43dc-a014-30633b3cb08d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02b7187c26dd41bea9f3c2b49de8ef28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd90ec194868c40c7909631544fecc3e8', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86095) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Dec 13 17:07:32.002637 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cc1c3-2675-43dc-a014-30633b3cb08d service placement] REQUEST_METHOD: `GET` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Dec 13 17:07:32.002918 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cc1c3-2675-43dc-a014-30633b3cb08d service placement] SCRIPT_NAME: `/identity` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Dec 13 17:07:32.003248 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cc1c3-2675-43dc-a014-30633b3cb08d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86095) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Dec 13 17:07:32.005228 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.fernet_utils [None req-dd1cc1c3-2675-43dc-a014-30633b3cb08d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86095) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Dec 13 17:07:32.017221 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cc1c3-2675-43dc-a014-30633b3cb08d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Dec 13 17:07:32.018805 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cc1c3-2675-43dc-a014-30633b3cb08d service placement] RBAC: Authorization granted {{(pid=86095) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Dec 13 17:07:32.029086 dv-cinder-821602-2-iscsi devstack@keystone.service[86095]: [pid: 86095|app: 0|req: 1446/2890] 10.222.0.62 () {60 vars in 1365 bytes} [Mon Dec 13 17:07:31 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)